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CHAPTER I 



INTRODUCTION 



Background 



Although there have always been philosophical theories dealing with 
man’s creativity, it has only been within the past decade that research 
psychologists and educators have taken a great interest in identifying 
creativity and developing tests of creative ability. Pioneering in the 
development of tests with which to assess the "creative" aspects of the 
intellect has been J. P. Guilford of the University of Southern Califor- 
nia (1956). Although some criticism is voiced regarding such tests of 
creativity (Thorndike, 1963) subsequent studies by Guilford and others 
using similar tests seem to substantiate the effectiveness of such tests 
for at least identifying aspects of the intellect which are different 
from those commonly measured by standard I.Q. tests (De Boer, 1965; 

Olshin, 1963; Sherman, 1965). These aspects of the intellect may be 
called "creativity." 

The use of such "creativity" tests has been limited by insufficient 
data regarding norms and by conflicting and confusing relationships ob- 
served between I.Q. levels and obtained creativity test scores. This 
need for more data regarding pupils tested using these devices has been 
particularly acute at the elementary school level since most of Guilford’s 
research was with air force cadets, college age and high school subjects. 

A revised battery of Guilford’s tests was administered to a large 
group of sixth grade children in central Indiana in 1965-66 as part of 
a project jointly sponsored by Indiana University and the U. S. Office 
of Education.. This group of approximately 900 students appears to be 
the largest single group to be tested at this grade level with these 
tests. The results of this testing were only partially analyzed in 
the original study and have not been reported beyond the USOE final 
report (Denny, 1966). 



The Problem 

The purpose of the present study was to conduct a detailed analysis 
of the test data obtained from the approximately 900 sixth grade children 
in central Indiana in 1965-66 using some of the Guilford tests of crea- 
tivity. It \7as believed that dissemination of the results of an analysis 
of these tests would serve as a source of comparison by school personnel 
should they administer the same or similar tests. Furthermore, it was 
believed the analysis would also contribute to the basic store of know- 
ledge regarding the "creative" aspects of the intellect, purported to 
be measured by these tests. 
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More specifically, the objectives of the study were as follows: 

1. To establish norm data from the battery of creativity tests adminis- 
tered to an Indiana population of sixth grade pupils in 1965-66. 

2. To obtain frequency of response scores for the originality sub-tests 
and to compare these scores with scorer judgment type "remote" scores 
initially obtained. To also examine the type and frequency of response 
in relation to socio-economic status, sex and I.Q. levels in order to 
estimate item validity for each level. 
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3. To perform an item analysis for each item in the battery of tests. 




4. To analyze and report on the relationships of measured creativity, 
socio-economic status, I.Q. and sex, with validity estimates (criterion) 
obtained from a peer nomination and interest and activity inventory. 
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5. To analyze construct validity by conducting a factor analysis of the 
test data. 

6. To prepare a report of the results of the analysis together with de- 
tailed administration and scoring directions for distribution to interested 
persons and to publish at least one journal article detailing the results. 
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CHAPTER II 



> 



REVIEW OF RELATED RESEARCH 



Although ;as long ago' as 1898 Dearborn investigated the relative in- 
dependence of intelligence and imagination, it has been during only the 
last fifteen years that educational research has concentrated its atten- 
tion on this area (1898). Also during this time there has been a marked 
increase in articles and books dealing with the topic in more subjective 
terms. Perhaps the increased interest has been unfortunate for it has 
resulted in the misconception by the general public and many professional 
educators that the research on creativity is much more definitive than it 
actually is. As a matter of fact, much of the research has been poorly 
designed and unjustifiable conclusions have been drawn (Thorndike, 1963; 
Skager, 1966). 



Relationships to General Intelligence 



The critics have pointed out that in a number of studies the re- 
stricted range of intelligence of the samples tested has resulted in 
faulty conclusions about the relationship of intelligence to creativity 
measures (Wodtke, 1963, 1964; Skager, 1966; Olshin, 1963; Pogue, 1965; 
Rambo, 1964), yet subsequent research with adequate range has indicated 
that the aspects measured as "creative" by so-called creativity tests, 
although positively correlated with measured intelligence, are not 
highly so (thfey range from .20 to .41), especially in the group beyond 
120 I.Q. (Schwartz, 1965; Sherman, 1965). 



A number of studies have attempted to determine if creativity is a 
psychologically independent entity. Considerable evidence indicates it 
is not since the criterion variables often used to validate creativity 
tests are also highly correlated with intelligence measures. Two rea- 
sons are proposed for the observed relationship with intelligence (Wal- 
lach, 1968). These are, (1) both tests share a conpon method variance 
and (2) the definition of creativity is very similar to that for general 
intelligence. However, it can also be argued that such an attempt to 
psychologically isolate creativity measures is spurious. It would ap- 
pear reasonable to assume, as does Guilford, that we are dealing with 
related yet varied aspects of intellect. 



. . . most of the abilities in the structure of the in- 
tellect may play appreciable roles in the complete 
operation of invention. The cognitive abilities are 
basic. Without having information there is no in- 
tellectual performance of any kind. (1962 p. 163) 



Another line of attack on the idea of a separate entity for creativity 
is found in the low positive intercorrelations of creativity tests. It is 
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argued these should be much higher if they are measures of the same entity 
(Thprndikej 1963). 

A conservative conclusion seoms to be that there are aspects of the in*~ 
tellect which are not measured by standard intelligence tests, but uhese are 
all aspects of a whole and interrelated# These could be called creative 
aspects of the intellect by virtue of their function. As originally developed 
through the independent research of Guilford (1956) and Lowenfeld (Lowenfeld 
and Beittel,. 1959) these are defined as fluency* flexibilxty, sensitivity, 
originality, and redefinition. 

Tests of these "creative" aspects have been developed and have under- 
gone revision by Guilford as well as others (Torrance, 1965). ihe critics 
have raised the question of the validity of the tests and the aspects they 
measure. In reply, Guilford presents a realistic view of the problem in- 
volved in determining originality. Since there is no way of knowing whether 
an idea ever existed before and one would need to know the history of the 
individual to know whether the idea was new to him, there are two ways left 
to determine originality empirically. One would be to determine the statis- 
tical frequency of a response in a population# The other would be to judge 
its social usefulness, but here subjectiveness- enters the picture; Guilford 
has used factor-analysis to determine related aspects. The next step^^would 
be to determine whether these factors relate to "creative" or "gifted" per- 
formance. Guilford's studies have oiily dealt with the factor-analysis 
S • * i 

Subsequent studies, in, which Guilforci's tests or tests purporting to 
measure similar aspects of creativity are compared to criterion variables, 
secim to substantiate their independehce of intelligeiice scores for some 
children (the high creative - low I.Q.'s) and the positive-relationship 
of intelligence and creativity with a correlatioii at about. the .50 level 
for children below llO I.Q. (DeBoer, .1965, Olshin, 1963, Sherman, 1965). 

High cteatives are also- found' to achieve at a' nigh level cn standard 
achievLient tests (DeBoer, 1965;. Sherman,' 1965). Other' studies seem to 
substantiate Guilford's findings that general creativity is rare and 
•that individuals' differ in the kind of creativity (symbolic;, verbal, 
concrete) (1962b). Jones .noted this difference x^rhen semantic creativity 
tes'ts Were found to be related to writing 'more than to creative drawing 
(1961). Bowers' st'udy of f earth, fifth, and sixth grade children also 
d.txonstrated differentiated aspects ' oi creativity • (1960 pp . 141-142). 

A - ilof study by Rusch, Be-nny, and .Ives ’ indicated the' same aspects of 
"creativity" could' be used to design a test for ..the dramatic arts (1964). 

One might safely conclude from the resea'rch dealing with the identi- 
fication of the aspec'ts of 'the intellect, that these aspects are factors, 
which differ from .intelligence as measured, and xvrhich have ^ low positive 
correlations and thus r^l^te 'to lorm factors which are varied in pattern 
aind relationship. 



Relationships of Creativity to Socio-economic Status, Sex and Age 

Findings often conflict regarding 'the relationship of creativity 
scores for differing socio-economic levels. Getzels and Jackson ci'ted 
different parental attitudes for high-creative, high i.Q. subjects 
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C1962 pp. 62-74). Ellinger, in a study of 458 fourth grade children in 
Ohio also found a significant relationship between home environment and 
creativity as measured by Torrance’s Tests (1965). Pogue found no re- 
lationship between race and creativity but did note a relationship to 
socio-economic level (1965). In direct contrast Dever found no signif- 
icant relationship of creativity and parental attitudes as measured by 
questionnaires of 100 Negro parents in Texas (1964). Orinstein, in a 
study of second grade children, also failed to find a significant posi- 
tive relationship of permissiveness, loving attitudes,' and democratic 
attitudes of parents and their child's creativity (1961). The study 
might be criticized because of the limited size (N=45) and the measures 
used. At the junior high level, Rambo also failed to find significant 
differences between high and low creative pupils in regard to parental 
occupation, parent’s educational level, number of children in the fami- 
ly, child’s position in the family, and the parent with whom the child 
lives (1964) . 

Perhaps a major reason why these conflicting findings are found 
relative to socio-economic status is the use of global measures of 
status. There is logical and empirical evidence to indicate that a 
break-down of the global nature of socio-economic status to specific 
aspects would be more fruitful. Guilford (1967 pp. 387-392) suggests 
such factors as cultural advantages of the home (library, radio and TV, 
et cetera), attitudes and beliefs of parents, and neighborhood features, 
are related to intellectual level. "-Taylor (1964, pp. 99-102) believes 
such factors as success-orientation, peer-orientation, sanctions against 
questioning and exploration and the work-play dicotomy are forces which 
oppose creativeness. A recent study by Wade (1968) appears to lend sup- 
port to these conclusions as regards the home environment. She feels 
the unique variance of the creative tests (the variance not overlapping 
x%fith traditional intelligence measures) is subject to environmental stim- 
ulation in a manner not shared by the intelligence measures. More specif- 
ically she refers to freedom for fantasy behavior. Supporting evidence 
for this theory was obtained when creativity tests of fluency, flexibility 
and originality were administered to 105 tenth grade children in the upper 
middle class. In both professional and non-professional homes, those in 
which parents approve TV viewing obtained higher mean creativity scores 
than those in which TV viev/ing was not approved. 

There is considerable evidence to indicate differences in creativity 
between the sexes. Torrance (1962 pp. 110-114) cites his own research 
and that of others indicating emphasis on sex roles caused differential 
creativity test scores. Guilford (1967 pp. 404-405) lists 17 factors 
which appear to differentiate between males and females. These factors 
were compiled from a variety of sources and are only those in which a 
difference is clearly validated. Of the five factors generally considered 
creative, females appear to be higher in word, ideational and expressional 
fluency while boys appear to be higher in the divergent and convergent 
production of figural transformations. However, there is also evidence 
of a lack oi dif lerentiation mean scares between the sexes on creativ- 

ity tests (Yamamoto a-ad Chimb-in. s, i.966; Yamamoto, 1964). Taylor indicates 
emphasis on sex roles does not appear to inhibit creativity before the age 
of 5 years. (1964 pp. 78, 100). 

Most authors are agreed that there is substantial evidence to indicate 
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children show less creativity as they grow older, although there is a need 
for longitudinal studies since many studies have been restricted in range 
of age (Taylor, 1964 pp. 33, 78-79). Torrance, reporting his own research 
as well as that of others, shows decrements of creative production at grades 
5, 9, and 12 with a peak being reached at about 30 years of age (1962 p. 103; 
1965 pp. 107-119) . Guilford also indicates evidence that creative production 
tends to reach its peak at age 30 - 39. There is some variation between oc- 
cupations which is seemingly related to the amount of preparation necessary 
to accumulate the basic knowledge with which to be creative (1967 p. 424). 

The relationship between the socio-economic factors mentioned above and age 
are quite logical and require further investigation. 

Thus it would appear that the relationship between measures of creative 
and non-creative aspects of the intellect need to be further explored at 
various age levels. Furthermore, since the relationship of socio-economic 
status and sex to these measures is not at all clear, the development of age 
and sex norms and the further exploration of the influence of age, sex, and 
socio-economic status upon creativity test scores is also desirable. The 
research reported here is a further step in the direction of the clarifica- 
tion of these relationships. 
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CHAPTER III 



PROCEDURES 



The Indiana Study 



A revised battery of Guilford’s tests was administered to a group of 
sixth grade children in central Indiana in 1965-66 as part of a project 
jointly sponsored by Indiana University and the U. S. Office of Education. 
The tests were administered twice as pre and post measures of creativity 
in relation to hypotheses relative to teaching behavior related to pupil 
creative growth (Denny, 1966). 



Description of the Sample Tested 

Approximately 900 children in 30 classrooms located in four school 
systems within a 50 mile radius in South-Central Indiana were pre-post 
tested.* Thirteen classrooms were located in a newly consolidated county- 
wide school system. Six of these were located in elementary buildings 
within a municipality and the remaining seven were located in schools 

had recently been consolidated. These were typically single 
buildings housing kindergarten through twelfth grade. 

Another school system, similar to the first in that it was a county- 
wide consolidation, contributed 10 more sixth grade classrooms to the sam- 
ple. In this case seven of the 10 classrooms were located within the mu- 
nicipality, and the remaining three were located in rural buildings. In 
none of these cases were the separate buildings a kindergarten through 
twelfth grade school. All of the buildings had been remodeled to house 
only elementary grades. The facilities in this school system appeared 
to be more adequate than in the school system previously described. The 
classes were not as large, and the buildings and instructional equipment 
were of a more modern design. This school system evidently had a stronger 
financial case and had been consolidated a longer period of time than the 
one previously described. Tv;o classrooms were located in a third school 
system and were in the same elementary building located within a city. 

The five remaining classrooms were located in a fourth school system with 
four of the classrooms in a new, modern elementary building. The remain- 
ing classroom was located in a much older elementary building in a socially 
deprived suburban community. 

The sample was not selected as representative of any larger popula- 
tion. However, although not representative of the typical sixth grade pop- 
ulation, it may be representative of the sixth grade population in this 
geographic area. 



* Since absences and incomplete supplementary data influenced the 
number tested and the available data, the N varies from analysis to analysis. 
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Table 1 shows the distribution of sex, age, I.Q. and socio-economic 
status. Socio-economic status was determined using Warner’s scale (1949). 
From this scale a value from one to seven can be assigned which identifies 
status based on occupation of the child’s parents. A score of one is high 
and seven is low. 

The intelligence test scores were obtained from school records. These 
tests had been administered from two years to two months prior to the time 
of post-testing. Three intelligence tests were used in these four school 
systems: the Lorge-Thorndike, the Otis Quick Scoring, and the California 

Test of Mental Maturity. Although there are difficulties in justifying 
use of intelligence test scores derived from three different tests, these 
tests all yield standard deviation I.Q.’s and for this reason the scores 
were utilized without conversion. 



Description of the Test Battery 

Although the Guilford tests have been only moderately successful in 
validation with external criteria (Taylor, 1964, p. 35) they continue to 
show power to differentiate in factor analytic studies with younger sub- 
jects as well as with the adult population (.Guilford et. al., 1961; Mer- 
rifield, et. al., 1963). 

Five basic aspects of creativity have been identified and modified 
by the research of Guilford. These aspects are Originality, Sensitivity, 
Fluency, Flexibility and Redefinition (Guilford, 1962 a.). Whether or 
not the composite score of these tests result in an entity called "crea- 
tivity" does not appear to be entirely relevant. It is evident, however, 
that these tests measure unique aspects of the intellect which are not 
entirely measured by the usual intelligence tests. 

A battery of tests designed to measure these five aspects of crea- 
tivity were developed from those of Guilford’s. The battery was initially 
developed in a pilot study with sixth grade children conducted in New York 
state during the 1964-65 academic year. The tests, as developed, were es- 
sentially the same as those used by Guilford. Revisions usually consisted 
of minor changes in wording to make them more understandable for sixth 
grade children. In some cases the number of sub-test items was reduced 
from those in the original. There were also a few changes in the admin- 
istration of the tests and in the detail of the directions and examples 
given which were worked out during this pilot study. Since the tests 
are copyrighted it is not possible to include them in this publication. 
However, each aspect of creativity measured by the tests and descriptions 
of the type of test items is provided in Appendix B. 



Administration and Scoring Procedures 



Administration. The investigator administered all of the pre-tests 



and post-tests. Use of a single, trained person to administer the tests 
was believed to be especially important when using a test battery of this 
type, in which the attitude and motivation of the pupil is influential. By 
having one person administer all of the tests, consistency was obtained. 
The pupils were briefly enlightened as to the purpose of the tests and the 
study. They were told that the tests would be different from their usual 










TABI.E DJ.-.TfUlUn iOW OF SEX, IQ, . SOCIO-ECOWOMJC STATUS, PEER 



r'-fUUArjOM AH) ACTIVITY INVENTORY SCORES IN THE POPULATION:* 



S-E 

Stat\iB 
level N 


IQ 

LevcO 


N 


Sex 




Peer 

Nomination 


Acti vi ty 
Inventory 


1 




90~ 


134 


Males 


464 


X=5.22, 


X=28.40 




94 


91-1-19 


529 


Females 


433 


SD=6.32 


SD=15.34 


3 


103 


120+ 


153 


Total 


897 


K=:366 


N=776 


h 


120 


Total 


816 


• 









5 ?J>0 X=^105.63 

6 231 

7 Sh •K=7?S 

Total 893 

X=105,63 



SD=:19.08 



N=:7?8 ' 

* Different N'e are the resu3 t of incomplete data for all cases. 
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classroom tests and that they would find them fun and something for which 
they would not need to prepare » They were further cautioned to do their 
best and were encouraged to employ their original ideas and not to be 
concerned with handwriting, correct spelling, or proper sentence struc- 
ture. Every effort was made to build a positive rapport with the class 
prior to the administration of the tests. There were many evidences that 
such a rapport was established. 

The pre-test was administered in October, the post-test in April. 

One hour was required for administration of the battery, including the 
giving of directions. 

Alternate forms of the test battery were not available. Since ap- 
proximately six months intervened . between the pre-testing and post-testing, 
the use of the same form for the post-tests was not considered to be det- 
rimental. There were no evidences of pupil recall of items. The teachers 
were allowed to remain in the room during the pre-testing and to examine a 
copy of the test, however a copy was not left with them and they were cau- 
tioned not to discuss the test with the children. 

Scoring . The tests were scored by four research assistants who had 
received training for this purpose. This was necessary since only the 
Gestalt Transformation test was of an objective type. The remaining tests 
required the student to x-nrite out a response which required some judgment 
on the part of the scorer. Although, in order to establish reliability 
coefficients, two persons were trained and compared iii their scoring for 
a given test in the battery, in most cases only one person scored a given 
test for all classrooms for both pre-testing and post-testing. This was 
done to provide consistency in scoring. Scoring procedures provided by 
the publisher and by Guilford were used and revised where necessary. 

Analysis Procedures 

The objectives of the study were accomplished in two phases: those 
dealing with the further analysis and development of the test battery; 
and analysis concerned with exploring relationships of creativity with 
other variables for the population tested. 

The establishment of norm data . Means, standard deviations, mini- 
mum and maximum scores were computed for the total population and for 
sub-divisions of sex, X.Q., socio-economic levels and age. These compu- 
tations were for both pre and post test data. Differences between levels 
were examined using the t test. Tables of percentile rank and score for 
the total sample for each sub-test and total battery scores were also 
computed . 

Development of frequency scoring for originality . The originality 
test was initially scored by trained persons on the basis of detailed 
directions which discriminated between remote and obvious responses. This 
was a procedure suggested by Guilford (.1959). He points out, however, 
that this is only one way of determining originality. Another is to as- 
certain uncommonness of response (statistically infrequent in a given 
population) . There have been no published comparisons of both methods 
of evaluating originality. 
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The responses on the post-test consequences questions, previously 
scored remote or obvious, were listed and coded on IBM cards. These re- 
sponses were then counted and the frequency of occurrence was used to de- 
rive a score. The score consisted of the total number responding minus 
the frequency of the particular response. Thus, the more frequent the 
response the lower the score. This procedure is less stringent than that 
of Wallach and Kogan who considered only the single frequency responses 
as being original (1965). In the present study originality was considered 
to be a continuum in which the unique response received the highest score 
but the response occuring only a few times in the total population also 
received some credit. 

The responses given for each question and their frequencies are re- 
ported in Appendix A. 



■i 

Additionally, the responses were compared to see if there were mean- | 

ingful differences in frequency and type of response for boys and girls, j 

levels of I.Q. and socio-economic status. The chi-square test was used J 

to select significantly different frequencies of response between levels. 1 

This was done in those cases in which ten or more identical responses I 

were registered. The content of the responses was then compared to try I 

to determine reasons for the differences. I 

1 .; 



Validity and reliability . Estimates of reliability of the tests 
were obtained by the intercorrelation of items and by test-retest and 
split-half coefficients for the total test and its sub-tests. A fur- 
ther index of reliability (objectivity) was obtained by examination of 
scorer agreement when using the directions for arriving at scores for 
each sub-test. 



Two types of validity were examined. Concurrent validity was esti- 
mated by determining relationships of the test items, sub-tests and total 
test scores with two independent measures of creativity. Peer nomination 
was obtained by administering a questionnaire called "Who Does It?" The 
students were asked to respond with the name of the boy or girl in the 
class who would most likely "make up a new game, solve a problem at re- 
cess," etc. The questions were designed to indicate creative persons. 

The students in each class were assigned a score consisting of the total 
number of nominations received. A questionnaire was also administered 
to determine which students participated in independent activities con- 
sidered to be creative in nature. A list of 100 activities called "Things 
Done On Your Own" was presented and each student was instructed to check 
those he had participated in during the school year. He was directed to 
only list those he had done on his own; not those he had been required to 
do by his teachers, parents, or others. Each student's score- was the total 
number of activities checked. Both of these devices had previously been 
shown to hold a limited degree of validity (Taylor, 1964, pp. 41-45; 
Yamamoto, 1964). 

Construct validity was' estimated by factor analyzing the test data 
to see if the items resulted in each of the factors which Guilford had 
previously identified with these items (Merrifield, Guilford, and Ger- 
shen, 1963; Guilford, Merrifield and Cox, 1961). 
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Item analysis . The intercorrelation of items with sub-test and 
total test scores and correlation with the criterion measures of peer 
nomination and interest inventory scores was examined to indicate over- 
lap of items, item validity and reliability. 









CHAPTER IV 



FINDINGS 



Norm Data 



The Total Population . Tables 2 through 10 present means, standard 
deviations, minimum and maximum scores for the total population and for 
sub-divisions of sex, I.Q. , socio-economic status and age. 



Table 2 presents data for the total population on both pre and post 
testings. It will immediately be noted that the lower limit of the sub- 
tests was too high in that the minimum score was zero in all cases. It 
will also be noted that in the case of Originality-Clever and Originality- 
Remote the scores were skewed. This should be considered in interpreting 
other data to be presented relative to the Originality variable in this 
report. 



Sex Differences . In Tables 3 and 4 the same data is presented sub- 
divided by sex. Table 3 presents pre-test data and Table 4 presents post- 
test data. The t test was used to compare the mean difference between males 
and females for each sub-test and the total score. It will be noted that on 
both pre and post tests the females had a significantly higher total mean 
score (p < .01) than did the males. It is interesting to note that the fe- 
males also had significantly higher mean scores than did the males on a 
number of the sub-tests with the exception of the Redefinition test on 
which the males mean score was significantly higher (p <^.05 on the pre- 
test and p < .01 on the post-test). This may be a factor of the test con- 
tent and format. It will be noted later on in this report that the item 
content for the Gestalt Redefinition Test appears to pertain to the mechan- 
ical interests of the male. It will also be noted in Tables 23 and 24 that 
the Redefinition items do not have as high a correlation with the other 
items of the test, indicating a dissimilar test. It is not possible to 
say from this analysis that girls tend to exhibit more creativity than 
boys or whether it It a case of the test being biased for girls. At any 
rate, those using the test x^/ould do well to use separate norms for girls 
and boys. 



Intelligence Level Differences . Tables 5 and 6 report data for pre 
and post tests sub-divided by I.Q. levels. Level 1 is defined as I.Q. of 



90 (N=127) and below; Level 2 is defined as i.Q. of 91-119 (N=501) and 



Level 3 is I.Q. of 120-r (N=146) . In all cases (pre and post) for all 



sub-tests and total score there were mean differences between levels of 
I.Q. signiiicantly greater than the .01 level of confidence. In all 
cases the higher I.Q. level had a significantly higher mean creativity 
test score. This finding reflects the correlation of .61 for post-test 
total score and I.Q. as reported in Table 24. The test user will thus 
obviously also need to consider I.Q. level when interpreting the crea- 



tivity test scores. 
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ABLE 2. PKE AND POST-TEST MEANS, STANDARD DEVIATIONS, 

MAXIMUM AND MINIMUM SCORES * 




1 



•1 






1 

V 

if* 


V;ariable 


’ X 


Si) 


Max. 


Min. 


1 


Redefinition 


5.51 


2 . 64 .'' 


15 


0 


1' 

"a 

5- 


Flexibility 


5.57 


3.98 


22 


0 




0 riginality- Clever 


.72 


1.51 


12 


0 


!‘ 


Sensitivity 


15.24 


5.39 


30 


0 


V 

P, . 

: 


Originality-Remote 


1.03 


1.45 


13 


0 


Fluency 


8.33 


4.18 


29 


0 


t, 

t 

> » 


Total-Pretest 


36.59 


13.56 


88 


4 


f ! 
1 '■ 


Redefinition 


7.06 


3.04 


15 


0 




FlexLbility 


8.85 


4.58 • 


23 


0 


1 


0 ri ginality- Clever 


1.45 


2.11 


1 4 


0 


i ‘ 


Sensitivity 


16.95 . 


5.46 


30 


0 


Jv 


0 riginality-Remot e 


2.50 


2.37 


14 


0 


I; 

Ifc - 


Fluency 


11.05 


4.94 


27 


0 


P' 

'v 

1- 


Total-Post-test 


47.90 


16.74 


93 


3 


1 


* N = 8^8 Pre-test 


, 896 Post 


-test. 










I 
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■3 
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TABLE 3. PRE-TEST MEANS, STANDARD DEVIATIONS 
MAXEMDM AND MINIMIJM SCORES BY SEX 



Variable 


Sex 


. X' 


SD 




Max. 


Min.’ 


t 


Redef . 


M 

F 


5.66 

5.36 


2.84 

2.42 




15 

13 


0 

0 


2.575^ 


Flex. 


M 


5.74 


3.39 




22 


0 


.49 




F 


5.SI 


4.06 




22 . 


0 


Orig.C. 


M 

F 


.76 

.67 


1 .54 

1 .4B 




12 

8 


0 

0 


1.02 


Sensi . 


M 


14.55 


5.25 




29 


0 


8.48---«- 




F 


15.96 


5.44 




30 


0 


Orig.R. 


M 


.97 


1 .36 , 




9 


0 


1.39 




F 


1 .09 


1 .53 




13 


0 


Flu. 


M 

F 


7.75 

8.91 


4.01 

4.28 




22 

29 


0 

0 


7.93-x-x- 


Total 


M 

F 


35.52 

37.69 


13.38 

13.67 




88 

B3 


4 

4 


8.21-'^-'^ 




N = 


Males 


= 392; 


feraales = 3B2 








\f 


Significant at 


.05 


level 








y~ 


Significant at 


.01 


level 







'I 
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TABLE 4 . POST-TEST MEMS, STANDARD DEVIATIONS 




i 



r ^ 

f*,4 







hi 

I ' 












^lAXBIUM AND MINIMUM SCORES BY SEX 



Variable 


Sex 


X 


SD 


Max. 


Min. 


t 


Redef . 


M 


7.36 


3.03 


15 


0 


4.88^»'' 




F 


6.75 


3.01 


15 


0 


Flez:. 


M 


8.99 


4.35 


21 


0 


1.82 




F 


8.71 


4.80 


23 


0 


Orig.C. 


M 


1.49 


2.12 


14 


0 


.86 




F 


1 .40 


2.11 


10 


0 


Sensi. 


M 


16.40 


5.34 


29 


0 


6.75^^% 




F 


17.53 


5.52 


: 30 


0 


Orig.R. 


M 


2.3B 


2.29 


12 


0 


2.1 7-- 




F 


2.62 


2.44 


u , 


0 


Flu. 


M 


10.49 


4.86 


'•27 


0 






F 


11 .62 


4.95 


27 


0 


7.10--"'' 


Total 


M 


47.09 


16.47 


93 


4 


5.585‘---' 




F 


48.73 


17.00 


93 


3 




N = 


Males = 


392; 


females =382 







Significant at .05 level 
Significant at .01 level 
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TABLE 5. PKE-TEST KEANS, STANDARD DEVIATIONS 



MAXIMUM AND >DISIMUM SCORES BI IQ 



Variable 


IQ Level 


M. Y 

rr ^ 


SD 


Max. 


Min. 


■*^1,2 


■*^2,3 


h ,3 


Redef . 


1 


3.92 


2.11 


10 


0 




10.61 


16. 40 


2 


5.47 


2.46 


15 


0 


10.09 




3 


7.06 


2.82 


13 


1 








Flex. 


1 


2.80 


2.95 


13 


0 




16.15 




2 


5.70 


3.63 


22 


0 


15.62 


25.75 




3 


8.62 


3.92 


22 


0 








Orig.C. 


1 


.25 


.76 


4 


0 




8.72 


9.04 


2 


.58 


1 .34 


10 


0 


3.00 




3 


1.59 


2.13 


12 


0 








Sensi. 


i 


11 .82 


5.3s 


24 


0 




9.36 






2 


15.47 


5.02 


29 


0 


16.28 


20.19 




3 


17.45 


5.20 


30 


1 








Orig.R. 


\ 


.57 


1 .00 


6 


0 




4.62 


6.86 


2 


1 .00 


1.45 


13 


0 


3.71 




3 


1.53 


1 .62 


9 


0 








Flu. 


1 


5.43 


3.75 


18 


0 




9.78 






2 


8.48 


3.98 


29 


0 


15.48 


20.59 




3 


10.31 


3.87 


22 


2 








Total 


1 


24.37 11.24 


57 


4 




30.18 






2 


36.66 11 .97 


88 


7 


34.51 


51.70 




3 


46.53 


12.51 


80 


16 










#IQ Levels: 


1 = 90, 


N = 127 




P < 


.05 t = 


1.96 








2 = 91- 


•119, N = 


501 


p .01 t = 


2.53 



3 = 120+, N = U6 



TABLE 6 



POST-TEST MEMS, STAKDARD DEVIATIOKS 
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^lAXEMIM AND MNIKtM SCORES BI IQ 



Variable 


IQ Levelj^ 


X 


SD 


Max. 


Min. 


S,z 


^3 


" 1,3 


Redef . 


1 


5.17 


2.42 


12 


0 










2 


6.91 


2.82 


15 


0 


10.58 


14.60 


20.31 




3 


9.23 


2.97 


15 


2 








Flex. 


1 


5.21 


4.08 


16 


0 










2 


8.75 


4.03 


20 


0 


17.73 


19.16 


29.12 




3 


12.38 


4.15 




r* 








Orig.C. 


1 


.50 


1.33 


8 


0 










2 


1 .27 


1 .86 


3 


0 


5.85 


12.03 


13.70 




:> 


2.89 


2.71 


14 


0 








Sensi. 


1 


13.43 


5.71 


ZI 


0 










2 


16.95 


5.03 


30 


2 


15.59 


14.78 


23.91 




3 


20.05 


4.77 


30 


7 








Orig.R. 


1 


1 .13 


1 .43 


8 


0 










r' 

<. 


2.39 


2.26 


12 


0 


8.77 


11.73 


17.05 




rs 

> 


4*07 


2.53 


14 


0 








Tiv.. 


i 


7.29 


3.99 


21 


0 










r 


11 .05 


4.47 


S- 


0 


18.10 


16.16 


27.27 






14.30 


4.92 


27 


4 








Total 


1 


32.73 


14.11 


79 


3 










2 


47.35 


13.92 


91 


14 


39.39 


44.29 


65.51 






63.01 


14.86 


93 


27 










4 ' IQ Le^' el ■; . 1 


II 

0 

!1 


127 




P < 


.05 t = 


1 .96 






2 


= 91 - 119 ; 


I-: t 
11 
0 




P < 


.01 t = 


2.53 



3 = 120+, r; = 146 



i 

I 



I 







Age Differences . Tables 7 aiid 8 report test data sab-divided by 
four levels of age. Level 1 was 10 years of age or less (N»57) , Level 2 
was age 11 (N»563), Level 3 was 12 years (N«115) and Level 4 was 13 years 
or more (N®39). As in the previous analysis, the means of each level 
were compared to determine if there were significant differences between 
levels. Although differences were not always significant, inspection of 
these tables reveals a direction of differences in keeping with the theory 
that as children become older they become less creative. In all cases the 
older levels had lower mean sub-test and total test scores than did the 
younger students. In some cases the 10 years or below group had signif- 
icantly lower mean scores than did the 11 year old group but the age 10 
and below group still had a higher mean score than the 12 and 13+ group. 
Caution, however, should be used in interpreting seeming differences be- 
tween age levels. These differences may actually be due to differences 
in I.Q. level since age 13+ is rare for the normal sixth grade child one 
would expect such students to be the less intelligent repeaters. Also, 
since age 10 or below is low for grade six most of these students are un- 
doubtedly from the two classes which were 5th-6th combination grades and 
the school location may be the relevant factor in this case. 

Socio-economic Level Differences . The data was further analyzed by 
levels of socio-economic status as established by Warner’s ranking of 
parental occupation (Tables 9 and 10) . In this system a rank of 1 is 
high and 7 low. In this analysis levels 1 and 2 were combined as were 
levels 6 and 7 in order to obtain larger N’s at these extremes. Thus 

the level 1 represents higher executives of large concerns, proprietors 
(larger stores), major professionals, business managers, and lesser pro- 
fessionals (N=86) . Level 2 represents administrative personnel, owners 
of small businesses (e.g. beauty shop), farmers, and minor professionals 
(N=93) . Level 3 represents clerical and sales workers, technicians, and 
owners of little businesses (e.g. newsstand) (N=104) . Level 4 includes 
skilled manual employees and small farmers and tenant farmers (N=229) . 
Level 5 includes machine operators, semi-skilled employees, and un- 
skilled employees (N=262) . 

For total mean scores on both pre and post tests the differences 
between all levels were significant at the .01 level. The higher socio- 
economic levels had higher mean scores than the lower socio-economic 
levels. One would suspect this is indicative of a general bias of the 
written test and content of all items toward the upper socio-economic 
level student. Supporting this conclusion is the fact that the rela- 
tionship of higher means for higher socio-economic levels was consistent 
for all items for the test battery, thus ruling out the possible inap- 
propriateness of particular items. It is also noted that socio-economic 
status correlated at .33 with I.Q. for the total population (N=778) and 
only .22 and .28 with the pre and post test total creativity scores. 
Knowing the relationship of socio-economic status to non-culture free 
tests of intelligence such as those used in this study, would lead one 
to conclude that seeming relationships of socio-economic status to 
creativity were the function of the relationship of socio-economic 
status to I.Q. Indeed, the partial correlation of status to post- 
test creativity when I.Q. is held constant is reduced to .11.* This 
is a net variance reduction of 6.6 percent. However, the -user of 



* Partial correlation estimated using a nomograph. 
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TABLE - 9 . PRE-TEST MEANS, STANDARD DEVIATIONS, MAXIMUM AND IffllCMUM SCORES BY LEVELS OF SOCIO-J'ICONOMIC STATUS# 










O' 



I 

EH 



lA 






JT\ 



4 ^ 






ir\ 



c \2 

-p 



cv 

-p 



c<^ 



C\2 

-p 



tf\ 

•s 

r— 

-P 



■<^ 

•s 

r— 

-P 



C^ 

•s 

r— 

-P 



CV 



-P 

• 

fl 

id 



n 

CO 



\x 



iH 

? 

0 ) 



-p 

03 

( 1 ) 

E -1 



to 

IT\ 



<^l'» 

in 

o 



in 



I; 

vO 



* 



o 



«^»> 

-.V 

£?- 

'vO 

to 






cn 

m 

■<^ 



CM 

ON 



?:« 

v 6 

to 

2 > 






ON 

cn 



cn 



CM 



o o 



O CM O O CM 
r- CM CM CN? CM 



nO (ONso in in 
cn o to V- o 

• • • • • 

^ cn cn -Nt 



nO to o CM cn 
to cn i> to in 

• • • n • 

cn cnto !> !> 



CM cn '<^ m 






?Jh 



cn 

NO 



* 



o 

f> 

■^\ 



>:< 



\D 



Sn 

o 



VD 



vO 

0 

O 



to 

o 

cv 



o 

•CO 

ON 



•si* 






\D 



o 

to 

o 

cn 



nd to o cn to 
i> vo to to to 



S cn ON o 
S s o o 

• • 






CM cn S m 



JO 



O 




ii 



t 



! 



to CM o S -<h 



cn r- cn s cn 



O r- to CM CM 

cn cn to m s 

• • • • • 

Q to m cn 
s cn cn cn 



CM 

NO 

CM 



in 



• *\ 

CM 

CM 






o 



ll 

cn 



•»\ 

cn 

cn 

c^ 



•»\ 

vO 

to 



w 

•H 



m 



no 

§ 



rd 

tiO 



a 



CO 

•H 



CD 

■s 

O 

CO 



CO 



0 

i 

I 



I 

m 



Ti 

0 

•H 



0 

-P 

0 

nd 



0 

I 

-P 

w 



o 

•g 



rH 

0 

0 

H 



rH 

0 

> 

0 

H 



O 

# 



o 



-p 

CCS 



4 ^ 

CCS 



-P -P 



H 


fl 


o o 


0 


o 


•H *H 




o 


Ch Ch 


0 


0 


♦H *H 


H 


I 

o 


S) i) 


pzq 


•H 


•H *H 


CO 


O 


CO CO 




O 




1 ! 


CO 




S 




vt» 

O'* *T^ 



25 









TABLE 10. POST-TEST MEANS, STANDARD DEVIATIONS, MAXIMUM AND MINIMUM SCORES BY LEVELS OF SOCIO-ECONOMIC STATUS# 
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r TABLE 11 STMDARD SCORES MD GENTILES FOR TOTALS 

PRE-POST TESTS 


Raw 

L Score 


Pre-test 

Standard 

Scores 


Gentile 


Post-tests 

Standard 

Scores 


Gentile 
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rri-tesu 

S-cx'.dard 

Score 


Cen^ile 


Post-tests 

Standard 

Score 


Gentile 
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64.397 


.923 
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64.994 


.929 


74 
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.993 


65.591 
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66.189 


.940 


76 
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66.736 
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7S 
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31 
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08 
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VC 
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75.149 


.991 
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2ABLE 12 . STAKDj-m) SCORES MD CEETILES FOE FLUEHCT 

PRE-POST TESTS 






Raw 

Score 


Pre-test 

Standard 

Score 


Gentile 


Post-tests 

Standard 
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Gentile 
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32.464 


.025 


29,656 


.009 
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.054 


31.680 


.016 
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37.249 
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39.641 
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•O64 
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44.426 
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46.818 


.414 
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.219 


8 


49.211 


.519 


43.826 


.292 
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51.603 


.607 


45.850 


.359 


10 


53.995 


.692 


47.874 


.452 


11 


56.388 


.766 


49.899 


.538 


•1 
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58.780 


.823 


51 .923 


.615 


13 


61.172 


.862 


53.947 


.680 


14 


63.565 


.900 


55.972 


.743 


15 


65.957 


.934 


57.996 


.797 


16 


68.349 


.958 


60.020 


.838 


17 


70.742 


.972 


62.045 


.373 


18 


73.134 


.983 


64.069 


.904 


19 


75.526 


.991 


66.093 


.927 


20 


77.919 


.994 


68.117 


.947 
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80.311 


.995 


70.142 


.967 
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82.703 


.997 


72.166 


.980 


23 


85.096 


.997 


74.190 


.988 


24 


87.488 


.997 


76.215 


.992 
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89.880 


.997 


78.239 


.994 
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Raw 

Score 


Px*G-test 

Standard 

Score 


Gentile 


Poat-tosts 

Stmidard 

Score 


Gentile 


26 


92.273 


,99S 


80.263 


.996 


27 


94.665 


.998' 


82.237 


.999 


2S 


97.057 


.998 


34. 311 


.999 


29 


99.450 


.999 


86.336 


.999 
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S?A3LE 13. STAIIDAHD SCORES MD CE-NTILSS FOR FLEnBILIKT 

PRE-POST TESTS 




Ravf 

Score 


Pre-test 

Standard 

Score 


Gentile 


Post-tests 

Standard 

Score 


Gentile 


1 


38.51 S 


.136 


32.860 


.047 


2 


41 .030 


.212 


35.044 


.077 


3 


43.543 


.291 


37.227 


.112 


4 


46.055 


.377 


39.410 


.158 


5 


4B.56fi 


.463 . 


41 1594 


.216 


6 


51 .080 


.555 


43.777 


.290 


7 


53.593 


.655 


45.961 


.377 


8 


56.106 


.737 


48.144 


.460 


9 


58.618 


.804 


50.327 


.532 


10 


61 .131 


.864 


52.511- 


.613 


11 


63.643 


.910 


54*694 


.702 


12 


66.1 56 


.939 


56.878 


.774 


o 


68 . 668 


.958 


59.061 


.829 


u 


71 .181 


.972 


61 .245 


.866 


15 


73.693 


.981 


63.428 


.899 


16 


76.206 


.988 


65.611 


.931 


17 


78.719 


.993 


67.795 


.957 


18 


81 .231 


.994 


69.978 


.974 


19 


83.744 


.995 


72.162 


.984 


20 


86.256 


.996 


74.345 


.992 


21 


88.769 


.997 


76.528 


.997 


22 


91 .281 


.999 


78.712 


.99s 


23 


93.794 


.999 


80.895 


.999 
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14. 



SmTDARD SCORES MD CMTILES FOR REDEFINITION 
PRE-POST TESTS 
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f 



Raw 

Score 


Pre-test 

Standard 

Score 


Gentile 


Post-tests 

Standard 

Score 


Gentile 


1 


32.917 


.031 


30.066 


.009 


0 


36.705 


.093 


33.355 


.029 


3 


40.492 


.193 


36.645 


.078 


/ 


44.2S0 


.313 


39.934 


.170 


5 


4S.068 


.458 


43.224 


.298 


6 


51.S56 


.604 


46.513 


to 

• 


7 


55.644 


.741 


49.803 


.565 


8 


59.432 


.839 


53.092 


.675 


9 


63.220 


.899 


56.382 


.767 


10 


67.008 


.938 


59.671 


.844 


11 


70.795 


.963 


62.961 


.900 


12 


74.583 


.982 


66.250 


.936 


13 


78.371 


.993 


69.539 


,966 


U 


82.159 


.997 


72.829 


.988 


15 


85.947 


.999 


76.118 


.997 
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TABLE 15- STAI;T)ARD SCORES AND GENTILES FOR ORIGINALITY- OLSm 

PRE-POST TESTS 



Raw 

Score 


Pre-test 

Standard 

Score 


Gentile 


Post-tests 

Standard 

Score 


Gentile 


2 


58.477 


to 

• 


52.607 


.696 


4 


71 .722 


.952 


62.0S5 


.863 


6 


84.967 


.986 


71 .564 


.948 


a 


98.212 


.994 


81 .043 


.987 


10 


111.457 


.998 


90.521 


.998 


12 


1 24.702 


.999 


100.000 


.998 


14 


137.947 


.999 


109.479 


.999 









TABLE 16. 



STMDARD SCORES ARfD GENTILES FOR ORIGINALITI-REMDTE 



PRE-POST TESTS 



Raw 

Score 


Pre-test 

Standard 

Score 


Gentile 


Post-tests 

Standard 

Score 


Gentile 


1 


49.793 


.608 


43.671 


.324 


2 


56.690 


.813 


47.890 


.511 


3 


63*586 


.911 


52.110 


.659 


4 


70.483 


.954 


56.329 


.780 


5 


77*379 


.978 


60.549 


.865 


6 


84-276 


.988 


64.768 


.918 


7 


91.172 


.993 


68.987 


.945 


8 


98.069 


.995 


73.207 


.961 


9 


1 04.966 


.997 


77.426 


.981 


10 


111.862 


.997 


81 .646 


.990 


11 


118.759 


.998 


85.365 


.994 


12 


125.655 


.998 


90.O84 


.998 


» J 


132.552 


.999 


94.304 


.998 


u 


139.440 


.999 


98.523 


.999 
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TJ\3LE 17. STMDARD SCARES .m CMILES FOR SENSITIVITI 

PRE-POST TESTS 



Raw 

Score 


Pre-test 

Standard 

Score 


Gentile 


Post-tests 

Standard 

Score 


Gentile 


1 


23.581 


.007 


20.788 


.006 


2 


25.436 


.011 


22.619 


.008 


3 


27.291 


.018 


24.451 


.011 


4 


29.147 


.026 


26.282 


.016 


5 


31.002 


.031 


28.114 


.022 


6 


32.857 


.046 


29.945 


.030 


7 


34.712 


.064 


31 .777 


.038 


S 


36.563 


.085 


33.608 


.049 


9 


38.423 


.122 


35.440 


.073 


10 


40.278 


.172 


37.271 


.104 


11 


42.134 


.228 


39.103 


.140 


12 


43.989 


.290 


40*934 


.184 


13 


45.844 


.358 


42.766 


.236 


14 


47.699 


.424 


44.597 


.299 


15 


49.555 


.488 


46.429 


.375 


16 


51.410 


.559 


48.260 


.449 


17 


53.265 


.630 


50.092 


.513 


18 


55.121 


.696 


51 .923 


.574 


19 


56.976 


.757 


53.755 


.631 


20 


53.331 


.812 


55.586 


.690 


21 


60.686 


.853 


57.418 


.746 


22 


62.542 


.891 


59.249 


.794 


23 


64.397 


.924 


61 .081 


.847 




iliiliiiiiiiiiiiiiiiiiiiiM 
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I 



O 

ERIC 



SElM'SITIVITY (continued) 



Raw 

Score 


Pre-test 

Standard 

Score 


Gentile 


Post-tests 

Standard 

Score 


Gentile 


24 


66.252 


.950 


62.912 


.893 


25 


68.108 


.967 


64.744 


.930 


26 • 


69.963 


.979 


66.575 


.955 


27 


71.818 


.9SS 


68.407 


.975 


28 


73.673 


.994 


70.238 


.986 


29 


75.529 


.998 


72.070 


.991 


30 


77.384 


.999 


73.901 


.997 
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these tests would dp well to consider socio-economic status of his stu- 
dents when using the norm data. 

Scores and Gentiles . Tables 11 through 17 present standard 
scores and centiles for each sub-test and total score computed from the 
pre and post test. 



Frequency Scoring of the Consequences Test 

The Two Methods Compared . The correlation of the remote- judgment 
method of scoring the Consequences Tests with the frequency of response 
method was .436 (N=755) . This correlation is surprisingly low for a sup- 
posedly alternate method of measuring an entity known as "originality". 
However, the degree of correlation has undoubtedly been attenuated by im- 
perfect reliability of each procedure (Guilford, 1965, p. 486). Table 18 
presents the intercorrelations of the tests scored using the frequency 
procedure. Table 23 shows the intercorrelations of all test items for a 
random sample of 124 post-tests. The average intercorrelation of items 
1 and 2 and items 3 and 4 of the Consequences Test scored using the fre- 
quency method is .366. The intercorrelations of these items using the 
remote method is .433. This would indicate comparable items in spite of 
the method of scoring used. 

A distinct advantage of the frequency of response method of scoring 
the Consequences Test for Originality is the increased objectivity. There 
are only minimal judgments necessary such as deciding if different wording 
implies different meaning or is equivalent to another response. No judg- 
ments of the remoteness or obviousness of a response are called for. Thus, 
another interesting interpretation of the low correlation of these two 
scoring methods is that the remoteness score may be more of a measure of 
the frequency of a response in the experience of the scorer population 
rather than the frequency in the population of subjects taking the test. 

Appendix A of this report contains a listing of all responses for 
each item and their frequency. The researcher interested in comparing 
responses for other populations may find this valuable. 

Table 19 presents the mean scores and standard deviations for each 
item using the frequency method. 

Differences in response by Sex, I.Q., and Socio-economic Status . 
Responses made by ten or more persons (less original responses) were 
examined to see if significant differences in types of response were 
evident between the sexes, I.Q. level, and between levels of socio- 
economic status. Only responses occur ing ten or more times and dif- 
fering significantly (p < .05) in frequencies between levels using the 
Chi-square test of difference were examined. Tables 20, 21 and 22 con- 
tain these significantly different responses and related Chi-square 
values. The four questions for each of the items were as follows: 

1. What would be the results if none of us needed food any 
more in order to live? 

2. What would be the results if the entire United States west 
of the Mississippi became a dry desert? 



TABLE 18. 



INTEPCOPRELATION OF CONSEQUENCES TEST ITEMS 



WHEN SCORED USING FREQUENCY PROCEDURE (N=898). 
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TABLE 19. MEANS AND STANDARD DEVIATIONS OP 
SCORES OBTAINED USING THE F1REQUE]^:CY METHOD 
FOR CONSEQUENCES TEST ITEMS (N = 898 ). 



It«lR 


X 


SD 


1 


2109.8 


1468.4 


2 


1901.3 


1353.4 


3 


1674.7 


1214.9 


U 


1584.6 


1178.1 


Total 


7150.20 


3721.75 (N=775) 



mm 
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3. would be the results if everyone sudcenly lost the 
sense of balance and were unable to stay up more man a 
moment? 

4. hTiat would be the results if everyone suddenly lost the 
ability to read and write? 

The first digit of the code number in Tables 20 through 22 is the 
question number. The next digits identify category grouping and specific 
response. It will be noted in examining these responses that most could 
be logically linked to sex interests (Table 20) . For example many items 
significantly more frequent for females dealt with cooking and household 
activities where those significantly more frequent for males dealt with 
sports or animals. Since these responses are less creative (less original 
as defined) the sex linkage of conforming responses found by Torrance 
(1962, pp. 111-114) appears to be substantiated here. 

Examination of the differences in responses between I.Q. levels 
(Table 21) does not result in as clear a relationship as those between 
the sexes. However, if one examines the differences between observed 
and expected frequencies contributing to the Chi-square, it appears 
that where the high I.Q. level (120+) made more frequent than expected 
responses, the responses tend to be more esoteric possibly requiring 
more abstract thinking to arrive at a less obvious relationship. The 
correlation of I.Q. and total creativity of .61 and of the originality- 
remote scores and I.Q. of .31 (average of pre and post test correlation) 
further support this interpretation when it is realized that the responses 
analyzed here are the less original (since they are more frequent) and 
therefore should be expected to be even more highly related to I.Q. con- 
sistent with the theory which assumes I.Q. and creative response to be 
more highly related in ranges of I.Q. below 120 than above. 

It might be concluded, therefore, that to the extent originality 
scores are based on responses requiring more abstract thinking, the 
higher I.Q. students will produce a higher frequency of such responses 
and will obtain higher creativity scores. But when infrequency of re- 
sponse is important in obtaining a score we might expect a drop in the 
correlation of I.Q. and creativity. Since the frequency scoring method 
makes no judgment of cleverness or abstractness one would expect to find 
a lower correlation of I.Q. with originality with this method than with 
the remote judgment method. This’ is exactly what was found. The cor- 
relation of I.Q. to originalxty (frequency method) was only .09 (N=342) 
as compared to r = .41 (N=778) using the originality-remote method for 
post-test scores. 

Only three responses were significantly different between levels of 
socio-economic status (see Table 22) . No interpretation was attempted. 

An examination of unique responses made to see if significant 
relationships could be determinea. Unique in chis case referred to 
single responses in the total population. No relationships were dis- 
cernible. This would appear to support the conclusion that the factors 
of sex and I.Q. level discussed above for non-unique responses (responses 
made by 10 or more persons) are conforming factors related to non-creative 
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TABLE 20. SIGNIFICAKT LIFFEPEKCES BETWEEN ORIGIN ALITY RESPONSES FOR SEX 



Code 


Males 


Females 


Total 


2 

X 


Responses 


11030 


I'tCas.s ) 


35 ( 23.5 ) 




10.813 


No Doing Dishes 


11033 


11(19.8 ) 


27(18.2 ) 


3.8 


. 8.166 


No Need to Cook 


11036 


2 ( 8.8 ) 


15 ( 8.2 ) 


17 


9.350 


Save Going to the Store 


11207 


1 ( 6.2 ) 


11 ( 5 .« ) 


12 


7.37 


Loss of Jobs 


11302 


56 ( 68.6 ) 


76 ( 63.4 ) 


132 


4.818 


No Food Markets 


11409 


23 ( 17.2 ) 


10(15.8 ) 


33 


4.084 


Save Time 


11411 


2 ( 6.2 ) 


10( 5.8 ) 


12 


4.568 


Could Do More Things 


11501 


58 ( 71.8 ) 


80 ( 66.2 ) 


138 


5.529 


People Have More Money 


11701 


17 ( 23.9 ) 


29(22.1 ) 


46 


4.146 


No More Dishes 


11706 


70 ( 86 . ) 


97(80.2 ) 


167 


6.770 


No Stores 


11708 


6(13.0 ) 


19(12.0 ) 


25 


7.852 


No Cabinets 


IIC31 


18(13.00) 


7 ( 12 . 00 ) 


25 


4.006 


No Meals 


20504 


40 ( 32.2 ) 


22 ( 29.8 ) 


62 


3.931 


No Specific Animals 


20505 


11 ( 3^. 2 ) 


24 ( 16.8 ) 


3.5 


5.954 


Be Very Hot 


20512 


90(109.2) 


120 ( 100 . 8 ) 


210 


7.032 


Plants Would Die 


20517 


9 ( 15.6 ) 


21 ( 14.4 ) 


30 


5.817 


No Rain in West 


20522 


13(20.8 ) 


27(19.2 ) 


40 


6.093 


Die From Lack of Water 


20523 


2 ( 6.2 ) 


10 ( 5.8 ) 


12 


4.568 


No Schools There 


20603 


9(15.1 ) 


20(13.9 ) 


29 


5 . 14 i 


Couldn’t Stay Clean 


20606 


4 ( 10.9 ) 


17 ( 10.1 ) 


21 


9 . 081 


No Swimming 


20507 


1 -( 13 . 00 ) 


6 ( 12 . 00 ) 


25 


5.679 


No Towns in West 


30705 


41 ( 56 . 16 ) 


67 ( 51 . 84 ) 


108 


8.525 


Peoole Fall and Get Hurt 


30706 


5 ( 12 . 4 !^) 


19 ( 11 . 52 ) 


24 


9.340 


Bump Into Each Other 


30005 


77 ( 63 . 44 ) 


45(58.56) 


122 


6.038 


Everyone Crawl 


.31114 


3 ( 7 . 28 ) 


n( 6.72) 


14 


4.088 


People Go Crazy 


31306 


33 ( 23 . 40 ) 


12 ( 23 . 60 ) 


45 


8.205 


No Sports 


31307 


7(11.96) 


16 ( 11 . 04 ) 


23 


■ 4.285 


More Sitting Down 



df=l P .05^' 3.841 
P .01-" 6.635 





TABLE 21 . 



SIONIFICANT Bin'FERENCES BET.'VEER ORIGINALITY RESPONSES IQ LEVEL. 











Code 


IQ 


IQ 


IQ 


Total 


2 

X 


Responses 






-90 


91-119 


1204 - 










:» 1.302 


11 ( 19 . 68 ) 


80 ( 79 . 93 ) 


32(23.37) 


123 


7.015 


No Food Markets 




1 1503 


10(19.68) 


82(79.95) 


31(23.37) 


123 


7.304 


People Have Mox-e Money 




11908 


22 ( 12 . 48 ) 


50(50.70) 


6 ( 14 . 82 ) 


78 


12.520 


No Specific Foods 






5 ( 5 -^^) 


16(21.45) 


14 ( 6.27) 


33 


10.321 


No Need to Cook 


p 


!*» .<"'1 


2( 6.72) 


25(27.30) 


15 ( 7.98) 


42 


8.170 


No Restaurants 




11706 


9 ( 24 . 64 ) 


102 ( 100 . 10 ) 


43(29.26) 


154 


16.415 


No Stoves 




11 Q.I> 


5 ( 1.76) 


15 ( 7.13) 


1 ( 2.09) 


19 


8.033 


No Fr.rm Animals 




2030^* 


16(29.60) 


128 ( 12 Q? 5 ) 


41(35.15) 


185 


7.721 


Animals Would Die 




2050; 


11( 7.36) 


54(29.90) 


1 ( 8 . 74 ) 


46 


7.899 


People Would Move 




2051b 


13 ( 5 .^ 4 ) 


18(22.10) 


3 ( 6 . 46 ) 


34 


11.279 


Mo Houses in West 




20805 


3 ( 16 . 48 ) 


50(66.95) 


50(19.5?) 


103 


62.633 


Overpopulated in East 




50705 


17(15.36) 


52(62.40) 


27 ( 18 . 24 ) 


96 


6.115 


People Fall and Get Hurt 




3051^ 


2( 5.76) 


21 ( 23 . 40 ) 


13 ( 6 . 84 ) 


36 


6.774 


No Acrobats 


1 


30S05 


2(10.72) 


43(45.55) 


22(12.73) 


67 


13.850 


Couldn't Ride Bikes 




31206 


1 ( 5 . 84 ) 


23(15.60) 


io( 4.56) 


34 


10.287 


More Wheel Chairs 




in 104 


23 ( 34 . 24 ) 


156(1 39.10) 


35 ( 40 . 66 ) 


21.4 


6.530 


No Books 


I 


^<0901 


2( 8.32) 


29(53.80) 


21 ( 9 . 88 ) 


52 


16.168 


More Radios 


[ 






df =^2 P 


.05 1 5.991 








1 






P 


.011 9.210 
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rasponse and, charafora, the vary reason no relat;tonships could be dis- 
cerned in the unique responses was because they were unique and essen- 
tially unrelated to sex or I.Q. 



Reliability 

■ ?J^ternal consistency . Internal consistency was estimated by examin- 
ing the intercorrelation of items and correlation with total test score. 

This data is presented in Tables 23 and 24. The reader should be cautioned 

again about the skewed distributions for the Originality test when inter- 
preting this data. 

The data in Table 23 was derived from a random sample of individual’s 
post-test scores (N=124). It will be observed that the correlations of 
items with like items is generally higher than correlations of unlike items. 
One exception are the Alternate Uses test items which correlate with each 
^her at .575 and with two items of the Consequences test at .659 and .410. 
One explanation of this might be considered an indication of the validity of 
the Items. Since flexibility (measured by the Alternate Uses test) is de- 
number of sets of responses and is related to fluency (meas- 
ured by the Consequences test), this correlation could be expected theo- 
retically. As one is more fluent with ideas the likelihood of more sets 
of ideas increases. In fact, in some types of tests (e.g. Guilford’s 
Brick Test) both factors are scored from the same test. 

In like manner the sensitivity test items (Seeing Problems Test) cor- 
related at a somewhat higher than expected level with the Consequences Test 
1 ems (fluency) . Here again the relationship seems to support the item 
validity in that sensitivity to problems is considered a prerequisite to 
ideational fluency. The very high correlation of items 9 and 11 (.799) 
and 10 to 12 (.888) are due to the fact that these are the same items 
scored for two different factors (fluency and originality-remote). Such 
high correlations would suggest contamination of the two scoring pro- 
cedures.^ It is also evidence of the lack of independence of the two 
scores since both obvious and remote responses yield a fluency score and 
the remote responses alone yield an originality score. This procedure 
IS different from Guilford's in which only the obvious responses yielded 
a fluency score. However, it was the rationale of this investigation 
that the remote as well obvious scores should be considered an indi- 
cation of ideational fluency. 



P art-Total Relationships . Turning to Table 24 one can find the inter- 
correlations of sub-tests and the correlations of sub-tests with total 
scores for both pre and post testing. It will be noted that the low posi- 
tive correlations are similar to expectations and those obtained by Guil- 
ford in numerous studies. 

, lest-Retest Reliability. Also, fror. Table 24, It will be observed 
that the test-retest reliability is within acceptable limits ranging from 
.314 for originality-remote to .755 for total. 

Split-half Reliability . The item interc.orrelations (Table 23) were 
used to compute Spearman-Brown split-half reliability coefficients. These 
are presented in Table 25. Reliabilities ranged from .326 for the originality- 
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TABr.K 24. INTERCOPRELATION OF ALL MEASURES (N = 7?8) 
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clever score to .744 for the sensitivity score. Total test-retest relia- 
bility was .734. As it was suspected that the high correlations of items 
9 and 11 and 10 and 12 (see Table 23) were creating a particularly high 
split-half correlation for the total battery, this was recomputed omitting 
these items, \«Jhen 9 and 10 were omitted the r^^ was .728. When 11 and 12 
were omitted r^^ was .747. Both of these coefficients are quite similar, 
to that obtained when these items were retained. 

Inter-scorer Agreement . Since the tests were scored subjectively by 
trained persons using detailed guidelines, the extent of the inter— scorer 
agreement is also a relevant source of reliability data. Table 26 reports 
coefficients of agreement between scorers for each test for a random sam- 
ple of three classrooms. It will be noted that correlations ranged from 
.67 to .99, the lowest being the plot-titles test requiring a judgment of 
the cleverness of titles. The Gestalt transformation test (redefinition) 
was scored objectively and does not appear in this table. 



Concurrent Validity 



Concurrent validity was estimated by correlating items with measures 
of Peer Nomination and an Interest and Activity Inventory. 

It will be noted from examination of Tables 24 and 27 that generally 
low but positively and statistically significant coefficients were obtained 
when creativity measures were correlated with Peer Nomination and Interest 
Activity scores. Such a degree of correlation would indicate some validity 
for the creativity measures. However, the degree of validity and reliabil- 
ity held by the criterion measures themselves is of great importance (Guil- 
ford 1965 p. 488). Unfortunately, this data for the criterion measures was 
not available and a correction for attenuation not possible. However, it 
is reasonable to assume from the literature (Taylor, 1964) that reliability 
anc validity oi these measures is low and that estimates of creativity test 
> ‘validity obtained would only be higher should the reliability and validity 
be raised. Furthermore, these low. criterion correlations can be tolerated 
when the intercorrelations are low and there are a number of sub— tests in 
the battery (Guilford, 1965, p. 408). 

Little difference between items was noted in their relationship to 
the criterion variables. Furthermore it would appear that I.Q» and the 
criterion variables were not closely related with correlations of .28(f 
and .112 for 1.0. correlated V7ith Peer Nomination and Activity Inventory, 
nowever, the total test and the items appear to correlate more with the 
l.Q. scores than with the criterion variables. This may be due to the 
greater reliability of the l.Q. test. Also as Wallach and Kogan have 
indicated, the fact that it is a test situation may cause correlations 
of l.Q. and creativity to be higher than that obtained in a more play- 
like situation (1965, p. 292). 

A random sample of 107 cases was sub-divided by levels of I.Q., Sex, 
and Socio-economic status and the correlations of total battery score with 
the criterion variables examined (Table 28) . Although the N in some of 
these groups is very low the variation in correlation is of interest. For 
example, it will be noted that at the higher socio-economic status levels 
the correlation of creativity to l.Q. increases. This is exactly what 







TABLE 25. SPEARKAN-BPOWN SPLIT-RAIi' RELIABILITY COEFFICIET^TS 
COMPUTED FROM A SAMPLE OF POST-TESTS (N = 12k) ^ 



Test 


r 


Total 


.734 


Redefinition. 


.630 


Flexihil ity 


.730 


Ori(Tinality-C 


.326 


Sen si ti.vi. ty 


• 7kk 


Fluency 


.734 


Ori cri nali ty-R 


.464 












53 



TABLK 27. IHTP.RCOPRELATIONS OF A SAMPLE 
OF 107 CASES ITEM SCOPES. 



For 100 df two-tailed test. 
F .05 = .^95 
P .01 = .25^ 







Total Test 


Activity 

Inventory 


Nomination 


IQ 


1 


P.edef . 


.421 


.144 


.211 


.471 


2 


Redef . 


.556 


.098 


.072 


.278 


3 


Flex. 


.751 


.17i 


.277 


.582 


k 


Flex. 


.600 


.136 


.198 


.502 


5 


Ori g . C 


.365 


. 197 


.311 


.368 


6 


Ori g . C 


.313 


.260 


.088 


■ .174 


7 


Sens! . 




.389 


.370 


.353 


8 


Sens! . 


.654 


. 319 


.258 


.209 


q 


Flu . 


.794 


.123 


.328 


.453 


10 


Flu. 


. 6 q 6 


.273 


.165 


.339 


11 


Ori g . P 




.066 


.238 


.331 


1 ? 


Orig. P 


.313 


.287 


.183 


.255 


13 


Total 




.332 


.345 


.612 


H 


Act. Inver. 






.262 


.050 


13 


Nom. 








.232 






o 

ERIC 
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TAEl.E 28. CCPT?ELATI0N3 OF TOTAL CRi-ATIVITY (POST-TFr/P) , PI-ER W.KI- 
>-ATIO^’, ir'P’rOfT.sT irVE^’^TOPY AND IQ FOR VARIOUS OPOUPIPGS OF SUBJECTS 




Gronr)inp 


Act . 


Uom. 


IQ 


I'l ■ 


Total 


.532** 


.345** 


. 612 *^ 


107 


y-i 

D 

0 

1 


.237 


..331 


-.174 


12 


1.; OT.-VQ 


. U07 * * 


. 288 * ' 


. 439 ** 


72 


IJ 120+ 


.?3B 


.242 


. 044 . 


23 


Few a} es 


.2^0 


.573** 


a. 396 ** 


50 


Pales 


.367'^* 


.421** 


. 612 ** 


57 


.>0 ‘'tatus IvO 


.642* 


. 379 


. 744 ** 


12 


3;-' Status 5 


.033 


.496 


. 820 ** 


14 


■'J'l Eta tv: s 'i 


.379 


. 388 


V 327 


11 




. 4'~ 6 


. 28 ? 


. 496 ^* 


27 


r 

J o 


.136 


. .323 


. 591 * * 


26 


? V ' * tr* n ^ 


. ^’91 * 


. 561 * 


.521 


13 



n 



lERiC 









might be expected since these students would more likely have the necessary 
background to perform well on both measures. The relationship of creativity, 
to criterion measures, Peer Nomination and Activity Inventory is stronger 
for males than for females. The Activity Inventory also appears to be a 
stronger predictor of creativity for the extremes of socio-economic, status 
than for levels between. 



Construct Validity 



Construct'’ validity was estimated by factor analyzing the items to 
determine if the obtained factors were congruent with factors obtained by 
Guilford with other samples and in his previous sixth grade sample (Merri 
field, et. al., 1963, i960; Guilford, et. al., 1952, 1954, 1956;. Hoepfner 
and Guilford, 1965). 



Factor-Analysis Procedures . Since many of the score distributions 
were positively skewed and some were truncated, following Merrifield, 
Guilford and Gershen (1963), the distributions were dichotomized at the 
medians and a phi coefficient was computed to form a correlation matrix 
to be factor analyzed. This matrix is shown in Table 29. 



In accordance with the. BMD d3M program, using squared multiple cor- 
relations as estimates of communal it ies , a principal-components factor 
solution was effected in which all factors having eigenvalues greater 
than zero were extracted. Table 30 presents the principal-factor matrix. 
It will be noted that eight factors were extracted accounting for 100.43 
per cent of the total communality . The first five factors accounted for 
97.39 per cent of the communality. 



Seven factors were included in an orthogonal rotation of the factor 
matrix. This rotated factor matrix is presented in Table 31. It will be 
observed that two factors had no significant loadings (commonly considered 
.30 or above) and were referred to as residual factors. Five factors were 
left to be interpreted. 



Factor interpretation . The significant factors which were interpreted 
are presented in Table 32. In spite of the limitations of this factor anal* 
ysis, three of the hypothesized factors appeared to be supported thus pro- 
viding construct validity for these tests. .A fourth factor was implied. 



Clearly emerging was redefinition or Guilford's convergent production 
of semantic transformations (NMT) . The split-halves of the Gestalt Re- 
definition test loaded on this factor .54 and .45. Also loading on this 
factor was I..Q. at .41. Since this Tactor, unlike the others, is concerned 
with convergent production, the relationship to I.Q. is logical. 



Another clear factor was DMC, divergent production of semantic classes, 
or flexibility. The two Alternate- Uses tests loaded on this factor at .45 
and .51. Also loading on this factor was the Problems Test, Part 1 which ■ 
purports to measure sensitivity to problems. This vjas a secondary loading 
for this variable. It -will also be noted that Alternate Uses I had a sec- 
ondary loading on EMI, sensitivity to problems. The relationship between 
sensitivity and flexibility is not entirely unexpected. A similar finding 
was obtained in Guilford's junior high school group (1961). Since sensitivity 
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TABLE 3?. FACTOR INTERPRETATION* 





Variable 


DMT-DMU NMT 

I 


DMT-DNU 

II 


EMI 


DMC 


] 


Gestalt Redefinition 1 


.541 








2 


Gestalt Redefinition 2 


.452 








3 


Alternate Uses 1 


- 




.302 


.456 


4 


Alternate Uses 2 








.511 


5 


Plot Titles 1 










6 


Plot Titles 2 










7 


Seeine* Problems 1 




.317 


.382 


.301 


Q 


Seein/?: Problems 2 






.458 




9 


Consequences Total 1 




.714 






10 


Consequences Total 2 


.737 








11 


Conseouer.ces-Pemote 1 


. 3d 8 


.672 






12 


Consequer.ces-Remote 2 


.757 








13 


Activity Inventory 


• 




.406 






Peer Nomination 




.300 


(.298) 




1 3 


"r /-« 

-U * V * 


(.293) .412 









*“A} 1 variables with loadiniPjs of .30 or above were considered 
sigTiificant for interpretation purposes. 
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is considered a basic attribute to the other creative aspects this is also 
a logical relationship (Guilford, 1957). One would need sensitivity to a 
variety of possibilities in order to be flexible rather than having a mind 
set. 



The factor, EMI, evaluation of Semantic implications, or sensitivity, 
was obtained with both of the Problems Tests loading at .38 and .45. One 
Problems test (Problems 1) had secondary loadings on DMT-DMU II (.31) and 
DMC (.30). It will also be noted in the preceding discussion that Alter- 
nate Uses 1 had a secondary loading of .30 on EMI. The Activity Inventory 
had a loading of .40 on EMI which also appears to be a logical relationship 
since the more sensitive person would be more likely to have a variety of 
interests and thus have a higher activity score. 



Two factors combining DMT and DMU were obtained. It appears obvious 
that the high correlation between the fluency and originality scoring pro- 
cedures resulted in a failure of the scores to separate as different fac- 
tors. Guilford’s procedure was to score Fluency as, the total number of ob- 
vious responses and Originality-remote as the number of remote responses. 

In this study Fluency was the number of both obvious and remote responses, 
thus resulting in a lack of independence for the two scores.* Some indica- 
tion of validity is evident, however, in that the two items hypothesized as 
measuring Originality-remote (DMT, divergent production of semantic trans- 
formations) load together on DMT-DMU I at .36 and .73. It will also be 
noted that Peer Nomination (a measure of originality of ideas) loads at 
.30 on DMT-DMU II. 



The Plot Titles test items do not load significantly on any factors 
due to their low communalities , .09 and .04. 



It would appear reasonable to conclude that a satisfactory degree of 
construct validity exists for the revised tests of Redefinition (Gestalt 
transformation), Sensitivity (Seeing Problems), and Flexibility (Alternate 
Uses) . 



Item Analysis 



Gestalt Redefinition Test . Reliabilities of this test are adequate. 



^pli'-“half r .63 and test— retest r — .56. Since the test is objectively 
scored no inter— scorer correlation was computed. 



The Gestalt Redefinition Test was not as highly correlated with the 
total creativity battery score as other tests in the battery (r = .57). 

Its relationship to i.Q. was also relatively low (.443) . It does not ap- 
pear to overlap the other items in the battery. Construct validity was 
supported in the factor analysis. It would appear, as indicated by Guilford 



* Although the reasons for the DMU-DMT combination appears to be the 
lack of independence in the scoring procedure, it is interesting to note 
that Guilford (1967 p. 453) indicates that summing both remote and obvious 



scores would give a measure of both DMU and DMT with DMU dominant 



tl 



be- 



cause it has, been the writer’s experience that the variance of scores for 
obvious consequences is about double that for remote consequences". 
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(1957) to measure a. convergent aspect of the intellect as compared with the 
othe?: items which appear to measure divergent aspects. 

It will be observed that the odd items of the test contribute most to 
the relationship to Peer Nomination and Activity Inventory measures, as well 
as to I.Q. Furthermore, there is considerable difference betvzeen the com- 
munalities of the alternate items which may be considered an estimate of 
their reliabilities (.32 and .22). A reexamination of the wording of the 
items and their difficulty is suggested. 

Alternate Uses Test . This test has a very respectable split-half 
reliability (.73) as is its test-retest reliability (.67). There is al- 
so scorer agreement (.94 to .98). 

The test contributes substantially to the total battery score with 
r = .80. This test also has the highest correlation with T.Q. (r = .53). 
Construct validity was supported by the factor analysis. 

The two items making up Alternate Uses 1 and 2 appear to be compara- 
ble in terms of validity, both correlating comparably with total battery 
score, and with the criterion variables. It will be noted, however, that 
Alternate Uses 1 had a secondary loading of .30 on the EMI, sensitivity 
factor, indicating a certain degree of sensitivity contributing to a 
score of this item not evident on the other item. Although not appearing 
in the factor analysis it was observed (in Table 23) that the Alternate 
Uses 1 item had a higher correlation with Consequences 1 (Fluency) than 
with its mate. Otherwise there does not appear to be a serious overlap 
problem. 

Plot Titles Test . This test had the lowest reliability of any test 
in the battery (split-half = .32 and test-retest = .49). Agreement be- 
tween scorers was also lower (.67 to .91). An obvious needed correction 
would be a more detailed scoring guide to increase objectivity of scorer 
judgment of the clever responses. 

Correlations with criterion variables were low for this test. Con- 
struct validity was not established by the factor analysis. 

It would appear that Plot Titles 1 was more highly correlated with 
total battery i Peer Nomination and I.Q. than Plot Titles 2. However, two 
had a higher correlation to Activity Inventory. Plot Titles 1 had a 
higher correlation with Consequences 1 (Fluency) than to any other sub- 
test. One might conclude, therefore, that the two items were not com- 
parable with one being either easier or more easily scored than two. 

Seeing Problems Test . This test had high reliabilities of .74 for 
split-half and .58 for test-retest. Scorer agreement was very high (.97- 
.99). 

The test contributes substantially to the battery score (.76) and 
also has significant positive correlations with Activity Inventory and 
Peer Nomination measures. Correlation with I.Q. is .40, about the same 
as with the other tests. Construct validity was supported in the factor 
analysis . 

Both Seeing Problems 1 and 2 seem to be equally valid, correlating 
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similarly with total battery and Activity Inventory and Peer Nomination. 

When examining relationships to other tests (Table 23) it is observed 
that these items correlate higher with the Consequences Tests thari with 
the others in the battery. Although not borne out by the current factor 
analysis, the relationship of sensitivity to fluency and originality has 
been observed in other studies of those tests. Guilford points out that 
sensitivity to problems, while not a divergent aspect of the intellect, 
is a necessary pre-requisite to divergent production (Guilford, 1957). 

Consequences - Fluency . Relatively high reliability coefficients 
were obtained. Split-half reliability was .73 and test-retest was .60. 
Scorer agreement ranged from .94 to .99. 

The fluency score made the highest contribution to the total battery- 
score (r = .84). It was also positively and significantly correlated to 
Activity Inventory (.18) and Peer Nomination (.26). Relationship to I.Q. 
was .48. Construct validity was not clear since the scoring procedure 
did not allow independent scores for fluency and originality-remote (see 
preceding discussion) . 

There appear to be some differences between the two items when exam- 
ining the correlations with the criterion variables and their contribution 
to total battery score. Consequences 1 (Fluency) also correlates higher 
with Alternate Uses 1 (.65) than it does with any other item other than 
itself scored for Originality-remote. A reexamination of- these items 
would seem desirable. 

Consequences (Originality-remote) . Reliabilities for the Conse- 
quences tests were low. Split-half r = .46 and test-retest r = .31. 

Scorer agreement ranged from .86 to .99. Evidently the judgment involved 
in determining a remote as compared to obvious response was a factor in 
the loxcer reliabilities. This conclusion is supported when the alternate, 
frequency of response method, is compared (see the discussion of this pro- 
cedure and che findings when compared) . 

Consequences 1 and 2 appear to make a comparable contribution to the 
total battery score (.57 and .51) and the combined score for Consequences 
(Originality-remote) correlates .70 with total battery score. Relation- 
ships with criterion variables are positive and significant (.15 with 
Activity Inventory and .24 with Peer Nomination). Correlation with I.Q. 
is . 41 . Construct validity was not clear due to the lack of independence 
of the Originality-remote score and the Fluency score. However, it will 
be noted that Consequences 1 scored for Originality-remote had a secondary 
loading of .36 on the same factor on which Consequences 2 (Originality-re- 
mote) loaded at .73. 

There is a considerable variation in parts 1 and 2 and their relation- 
ship to Peer Nomination and Activity Inventory (Peer Nomination r = .06 
and .28 and Activity Inventory r = .23 and .18). Hoxijever, both items ap- 
pear to be comparably related to the total battery score. Consequences 1 
(Originality-remote) appears to share some variance with Alternate Uses 1 
(.42) and Seeing Problems 2 (.44). However, no serious overlap is evident. 




CHAPTER V 



SUMMARY, CONCLUSIONS AND IMPLICATIONS 



Summary 

A revised battery of Guilford’s tests was administered to a group of 
approximately 900 sixth grade children in central Indiana in 1965-66 as 
part of a project jointly sponsored by Indiana University and the U. S. 
Office of Education. 

The Problem . The purpose of the present study was to conduct a de- 
tailed analysis of the Indiana test data. It was believed that dissemin- 
ation of the results of these tests would serve as a source of comparison 
by school personnel should they administer the same or similar tests. 
Furthermore it was believed that the analysis would also contribute to 
the basic store of knowledge regarding the ’’creative" aspects of the in- 
tellectual purported to be measured by these tests. 

The objectives of the study were: 1) to establish norm data from 

the battery of creativity tests, 2) to obtain frequency of response 
scores for the originality sub-test to compare these scores with scorer 
judgment type "remote" scores initially obtained, 3) to perform an item 
analysis for each item in the battery of tests, 4) to analyze and report 
on the relationships of measured creativity, socio-economic status, I. Q. 
and sex, with validity estimates (criterion) obtained from a peer nomin- 
ation and interests and activity inventory, 5) to analyze construct 
validity by conducting a factor analysis of the test data. 

Procedures . The objectives of the study were accomplished in two 
phases: those dealing with the further analysis and development of the 

test battery; and analysis concerned with exploring relationships of 
creativity with other variables for the population tested. 

Means, standard deviations, minimum and maximum scores were com- 
puted for the total population and for sub-divisions of sex, I.Q., 
socio-economic level and age. These were computed for both pre and 
post test data and were used to establish norms for this population. 
Furthermore, the t test was applied to detect significant mean dif- 
ferences between levels. 

The originality test, initially scored using judgment of "remote- 
ness" by trained persons was rescored on a frequency basis. Individuals’ 
frequency scores were compared with originality scores in an effort to 
determine equivalency of the two procedures. Additionally, responses 
were compared to see if there were meaningful differences in frequency 
and type of response between levels of sex, I.Q., and socio-economic 
status. Comparison by frequency scores with remote judgment scores 
was made using correlation analysis. The chi square test was used to 
select significantly different frequencies of responses between levels. 
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Estiinstss of rGXi3.DiXit'.y of tibiG tssts wqic& obt«ixrxGd by intsrcorij'G— 
Xation of items and by test-retest and by spXit— haXf coefficients for 
the totaX test and its sub-tests. A further index of reXiabiXity (ob- 
jectivity) was obtained by examination of scorer agreement. 



Two types of vaXidity were examined. Concurrent vaXidity was esti- 
mated by determining reXationships of the test items, sub-test and totaX 
test scores with two independent measures of creativity. These indepen- 
dent measures were peer nomination and activity inventory scores. Con- 
struct vaXidity was estimated by factor anaXyzing the test data to see 

if the items resuXted in each of the factors that GuiXford had previously 
identified. 



^^terco rreXation of items with sub— test and totaX test scores 
and correXation with the criterion measures of peer nomination and in- 
terest inventory scores v/as examined to indicate overXap of items, item 
validity and reliability. 



Conclusions 



The following general conclusions were drawn from the findings 



Norm dac.a. It was concluded that the battery should be revised to 
provide a lower limit for the sub-tests and to result in less skewing of 
some of the sub— tests, especially Plot Titles (originality— clever) and 
Consequences (originality-remote) . 



It was concluded that with the exception of the Redefinition test 
the sub— tests in the battery appeared to favor females. 



It was further concluded that there were significant differences on 
creativity test mean scores between levels of intelligence. 



Differences between age levels were observed but it could not be con- 
cluded v/hother these differences were related to age or to intelligence 
since older children might have been retained in sixth grade. 



concluded that the XA^ritten test and content of all items was 
biased in favor of the upper socio-economic level student. 



Frequency ocorin g of the Consequences Test . Although it was not pos— 
make a definite conclusion there vijas considerable evidence to in- 
dicate the remote judgment method of scoring the Consequences Test for 
originality is not an accurate procedure. This general conclusion is 
based upon two subordinate conclusions. First, it would appear that the 
judgment of the remoteness of a response is a function of the scorer's ex- 
perience \>7ith that particular response, rather than whether the response is 
remote in c particular popu^.>.tion of subjects. Secondly, the 
definitions of originality as infrequency of response and remoteness of 
response do not appear to be compatible. The remote judgment method, 
apart from being less objective, as noted above, appears to reouire ab- 
stract thinking and thus be strongly and positively related to 1.0. as 
compared to the frequency method which x>?as not as strongly related to 
I . Q . 
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No conclusions V7ere possible regarding the relation.^hip of responses 
to levels of socio-economic status. Furthermore, no conclusions were pos- 
sible relative to unique responses and sex, I.Q. and socio-economic status. 
There was some evidence to indicate that the less original (more frequent) 
responses, when boys and girls vzere compared, support Torrance s hypothesis 
that conformity is linked to sex roles. 



Reliability . Acceptable. internal consistency was obtained when inter- 
correlation of items and correlation with total test score was examined. 



Test-retest and split-half reliability was found to be within accept- 
able limits. 



Inter-scorer agreement was -high in all cases . 



Concurrent Validity . Concurrent validity was considered acceptable 
with generally low but positively and statistically significant coeffi- 
cients obtained when creativity measures were correlated with Peer Nomin- 
ation and Interest Activity scores. 



It was also concluded that the creativity test items share consider- 
able variance with I.Q. test scores. 



No conclusive generalizations could be made regarding relationships 
of creativity test scores to criterion measures for levels of I.Q. , sex 
and socio-economic status. 



Construct Validity . Based upon a factor analysis of the items com- 
prising the sub-tests of the battery it was concluded that a satisfactory 
degree of construct validity existed for the revised tests of Redefinition 
(Gestalt Transformation), Sensitivity (Seeing Problems), and Flexibility 
(Alternate Uses). 



Item Analysis. It was concluded that the Gestalt Redefinition Test, 



the Alternate Uses Test, the Seeing Problems Test, and the Consequences 
Test scored for fluency were acceptable, reliable and valid measures of 
the aspects purported to be measured by these tests and should continue 
to be included in the battery . 



The Plot Titles test needs extensive revision to increase its relia- 
bility, to equalize the difficulty of its items and to substantiate its 
validity . 



The Consequences test scored for Originality-remote also needs fur- 
ther revision to increase reliability and to substantiate its validity. 

"c was concluded that a different method of scoring the Consequences Test 
for Fluency in which both remote and obvious scores were totaled to obtain 
a fluency score disguised rhe true validity of the originality-remote 
score. 
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Implications 

The implication of this study in regard to further use of these tests 
at this age level would appear to be that the test battery with the excep- 
tion of the Plot Titles sub— test is a reliable and somewhat valid measure 
at the sixth grade level. However j distinctions should be made between 
the sexes and intelligence and socio-economic levels when interpreting 
scores. The existence, however, of a separate entity apart from intel- 
ligence which could be called "creativity" remains questionable and should 
not be implied from the findings and conclusions of this study. 

There are a number of implications for further research which can be 
derived from this study. First, it would appear that the existence of a 
separate entity called "creativity" from that measured by standard intel— 
tests has not been established in this study but clues are avail- 
able which indicate further studies should be done to determine the effect 
of the test situation and the scoring procedures upon the obtained "crea- 
tivity" scores. This implication was strongly suggested when the frequency 
and remote methods for scoring the Consequences Test for originality were 
compared. 
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APPENDIX A. Responses to the Consequences 
Test and Their Frequency. 
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noi8 

U0t9 

IlOlO 

iioai 

11022 

lioaa 

1X024 

11025 

11026 
1102T 
11028 
11029 

tioao 

11021 

11092 

11093 

11094 

11096 

11097 
11099 

11040 

11041 

11042 

11043 

11044 

11045 

11046 
fUGl 
1 1102 
mo3 
11!104 

11105 

11106 

11107 

11108 
m«99 
lino 
iieoi 

11203 

11204 

11205 

11207 

11208 

11209 

11210 
11212 

11213 

11214 

11215 

11216 

11217 

11218 

11219 

11220 
1122X 
112X2 

11223 

11224 

11225 

11226 



020878 SAVE LAND 

001897 HAVE NOTHING BUT DEPARTMENT STORES 

003895 NO BEING LATE FOR SUPPER 

0Q2B96 ENDANGER THE ECONOMY 

003895 NO NEED TO THANK GOD FOR FOOD 

003895 NO ANIMALS ASSOCIATED WITH MANS FOOD 

002896 NO NEED FOR FERTILIZER 

001697 NO NEED FOR APPLIANCE DEALERS 

013885 NO NEED FOR GROCERY SACKS OR FOOD CONTAINERS 

003895 COULD GET TO SCHOOL ON TIME 

016882 9AVE HARD WORK FOR MOM IN THE KITCHEN 

081897 NQULONT HAVE TO KNOW TABLE MANNERS 

049849 NO DOING DISHES 

025874 NO MEALS 

001897 NO TOOTH BRUSH 

038660 NO NEED TO COOK 

002696 NO SETTING TABLES 

017881 SAVE GOING TO THE STORE 

001897 NO MORE TV DINNERS 

001897 NO MORE SCARECROWS 

001897 NO MORE COUNTRY 

002896 MORE CITIES 

•001897 NO MORE FOOD SHIPMENTS 

001897 NO PICNICS 

001897 NO THANKSGIVING DINNERS 

002896 NO CANNING 

014884 NO ANIMALS WOULD BE BUTCHERED 

002696 NO GREASE 

012886 NO NEED FOR SOIL 

001897 NO NEED FOR CAN OPENERS 

001897 NO NEED FOR WEIGHT SCALES 

001897 NO MORE BONES FOR DOGS 

001897 NO MORE JOLLEY GREEN GIANT 

020878 NO LUNCH HOUR OR COFFEE BREAK 

006892 NO HALLOWEEN TRICK OR TREAT 

011887 NO NEED TO WORRY ABOUT LACK OF FOOF 

006892 NO NEED FOR SUN 

049849 NO N8ED FOR FARMS 

066832 NO NEED FOR FARM EQUIPMENT 

007891 NO MORE PRODUCE TRUCKS 

011887 FARMERS WOULDNT HAVE TO WORK 

012886 LOSS OF JOBS 

024874 NO COOKS 

002896 NO NEED FOR FARM HOUSES 
009889 NO NEED FOR FARM HOUSES 
001697 NO USE FOR MILK COMPANIES 
807891 NO PEOPLE TO OWN STORES 
001897 NO NEED FOR PEOPLE TO MAKE PLATES 
003895 NO NEED FOR MEAT PACKING PLANTS 
003895 NO NEED FOR PLANTATIONS 
001897 NO LUNCH LADY 

00.1897 NO NEED FOR PEOPLE TO MAKE SILVERWARE 

003895 NO MORE BUTCHERS 

002896 NO NEED FOR FISHERMAN 

011887 NO NEED FOR WORKERS ON FARMS 

001897 NO MILKMEN 

002896 NO FARM DAY 

001897 REOPLE IN FREEZING PLANT OUT OF WORK 
001897 NO GARDENS 

002896 MORE PEOPLE WORKING IN FACTORIES 




C1227 


001897 


NO NEED FOR HUNTERS 


11228 


001897 


NO MORE RANCHES 


11219 


007891 


FARMERS MOULD GO OUT OF BUSINESS 


iiaol 


047851 


NO RESTAURANTS 


11302 


132766 


NO FOOD MARKETS 


11303 


001897 


NO CHINA FACTORIES 


11304 


002896 


NO SNACK BARS 


11305 


016882 


CANNERIES ELIMINATED 


11307 


005893 


NO MORE STORAGE 


11308 


016882 


NO CAFETERIAS 


11309 


003895 


STORES NOT SO BIG 


11310 


003895 


NO PACKING COMPANIES 


11311 


003895 


NO FRUIT OR VEGETABLE STANDS 


11312 


003895 


NO BAKERIES 


11313 


011887 


NO FOOD FACTORIES 


11314 


001897 


NO NEED FOR LUNCH ROOMS ' 


11401 


003895 


MORE TIME FOR TV 


11402 


' 014884 


COULD STUDY LONGER 


E1405 


029869 


COULD PLAY MORE 


E1406 


050848 


COULD DO MORE WORK WITHOUT STOPPING 


1 1407 


016882 


MORE SLEEP 


11408 


002896 


BE ON THE GO ALL THE TIME 


E1409 


033865 


SAVE TIME 


11410 


001897 


MORE TIME WITH THE CHILDREN 


11414 


012886 


COULD DO MORE THINGS 


11412 


001897 


MORE READING 


11413 


005893 


HAVE MORE FUN 


E1601 


E38760 


PEOPLE HAVE MORE MONEY 


11503 


002896 


COULD BUY MORE QF OTHER THINGS 


11601 


015863 


NO STARVATION 


11602 


001897 


NO MORE MALNUTRITION 


11603 


005893 


NO STOMACH ACHES 


11604 


007891 


NO MORE DISEASES FROM FOOD AS FOOD POISONING 


11605 


004894 


NO MORE UPSET STOMACHES 


11606 


002896 


YOU WOULDNT GET SICK FROM EATING 


11607 


001897 


NO WEIGHT PROBLEMS 


11608 


002896 


NO ONE WOULD VOMIT OR CHOKE 


11701 


046852 


NO MORE DISHES 


11702 


066832 


NO MORE KITCHENS 


11703 


005893 


NO MORE DINING ROOMS 


11704 


042856 


NO MORE COOKING PANS 


11705 


010888 


NO MORE NEED FOR NAPKINS 


11706 


167731 


NO STOVES 


11707 


025873 


NO DINING OR KITCHEN TABLES 


11708 


025873 


NO CABINETS 


11709 


053845 


NO NEED FOR SILVERWARE 


11710 


002896 


NO BAR 


11711 


005893 


NO CLOCK 


11712 


011887 


NO TABLE CLOTHS 


11713 


001897 


NO STRAWS 


11714 


003895 


NO FOOD SHELVES 


11715 


003895 


NO qiSH CLOTHS 


11716 


003895 


NO MIXERS 


11717 


004894 


NO DISHWATER SOAP 


11718 


018880 


NO DISHWASHERS 


11719 


002896 


NO HIGH CHAAIRS 


11720 


001897 


NO POPCORN POPPERS 


11721 


001897 


NO APPLIANCES 


11722 


003895 


NO KITCHENS OR DINING CHAIRS 


11723 


001897 


NO BREAD BOXES 
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ItfIS 

iitaa 

imt 

tma 

lift* 



IMOT 

11902 

11903 
81900 
11000 
11907 
11900 

11909 

11910 
imi 
11922 
11919 

lioio 

11917 

11910 

11919 

11920 

11911 

11912 

11913 
10101 
20101 
20103 
10107 
20100 
20109 
20120 
20111 
20112 

20113 

20114 
20201 
20202 

20203 

20204 

20205 
20207 



20209 

20210 
20211 
20212 

20213 

20214 
20219 
20210 
20217 
20210 
20210 
20221 
20222 

20223 

20224 



20229 



001097 

001997 

002996 

001997 

001997 

002996 

077921 

0279171 

093109 

029009 

001997 

017991 

084114 

002996 

003999 

001997 

033065 

003095 

002096 

022076 

021077 

021077 

001097 

001097 

001097 

001097 

002 896 
004 094 
001 097 
004 094 

003 095 
001 097 
001 097 
001 097 
001 097 
001 097 
001 097 

001 097 

002 096 
001 897 
00? 896 
001 897 

001 097 

002 996 

001 097 

004 094 

002 096 
004 894 
002 096 
001 097 
004 094 
001 097 
001 097 

001 097 
007 091 

002 096 
026 002 
001 097 
007 891 
901 097 



NO NEED FOR A GRILL 

NO COOK hare 

NO NEED OOR UTENSILS 

NO TOASTER 

NO HOT PLATES 

HI HOULD LIVE OIPPERENT 

NO 9AR0ENS 

NO 9AINING HEIGHT 

NO NEED POR MEAT PRODUCING ANIMALS 

NO MORE FEELING OF HUNGER 

NOULONT NAVE TO CARRY HEAVY GROCERIES ANY LONGER 

NO NEED FOR FARMING 

NO Specific FOODS 

FOOD MOULD GO TO HASTE 

NO GREEN HOUSES 

NO IRRIGATION 

NO SEEDS 

WOULD NEED SOMETHING ELSE TO MAKE BODY ENERGY 
ONLY FLOMERS IN GARDENS 
NO PARN ANIMALS 
NO HARVEST 
NO FRUIT TREES 

NOULONT HAVE THE SAYING HON THE COOKIES CRUMBLES 

FOOD SOURCES WOULD BECOME WILD 

NO NEED FOR RAISING ANIMALS 

NO OXYGEN FROM PLANTS 

HATER PIPED FROM EAST 

USE MATER FRON CACTUS 

TURN SOME RIVERS AROUND 

GET HATER FRON OCEAN 

DIG A WELL 

NEED TO DIG CANALS 

DISCOVERIES THAT NAKE RAIN CLOUDS 

MORE RAIN DANCES 

MORE HATER PURIFIER COMPANIES BUILT 

CARRY HATER THROUGH PIPES 

GOT HATER FROM MOUNTAIN STREAMS 

MORE AIR CONDITIONERS 

NO FLUMBBRS 

3T0P MUCH TRADE 

SALT LAKE DRY UP 

HOOD WOULD ROT 

NO SWANS IN WEST 

NO LOGGING CAMPS 

NO RODEOS 

LESS AND NEW CLOTHES HORN 
BUILD OASIS IN NEST 
NO SEASONS 

NO BRIDGES. DAMS. CANALS 

ARABIAN HORSES IN WEST 

NO NOVIES 

GET OAO SUNBURN 

NIGHTS COOLER. DAYS HOTTER . 

NEED MORE SUN GLASSES 
MORE SAND STORMS 
NO OROHNING 
POPULATION DROP IN US 
LOGGERS HOULD STARVE 
NO HOLLYHOOD 

GOVERNMENT MOULD SAVE MONEY 



A4 







202a« 013 «ts CAMELS USED 

20227 001 097 BUILD ARMY BASES IN EAST 

2022B 001 BB7 INDIANS HAVE LAND BACK 

20229 009 093 CROUNO BECONE CRACKED 

20BBO 001 897 BUILD GIANT SAND CASTLES 
20tBl 009 093 NO BOATING 

20802 007 B91 VACATION SPOTS GONE 

20203 001 097 GIANT SAND BOX 

€0204 Oil 087 GHOST TOHNS IN VEST 

20209 006 092 NO ROADS 

20206 014 004 FEWER PARKS 

20207 019 004 DIRT BECOME SAND 

20208 010 088 BEAUTIFUL LAND DESTROYED 

20209 003 099 00H80YS HAVE NO JOBS 

20800 0X5 883 MORE WASTELAND 

20842 002 896 NO HOUSE BOATS 

20843 004 894 NO IRRIGATION 

20844 004 094 NO WATER FAUCETS t PIPESt PUMPS ' 

208.45 001 897 NO WINTER OLYMPICS THERE 

20847 001 897 NO MORE ZOOS 

20848 002 896 NO MISSISSIPPI RIVER 

20249 002 896 SNOW MELT ON MOUNTAINS 

20250 013 885 NO FISHING OR HUNTING 

20251 007 891 DESERT ANIMALS LIVE THERE 

20263 001 897 SINUS SUFFERERS WOULD NOT LEAVE 

20269 001 897 HAVE A SAND FIGHT 

20266 003 895 NO COATSt SLACKSt SOCKSt WINTER CLOTHES 

20257 001 097 NO HEATERS 

20268 005 893 LACK OF PRODUCTS 

20269 002 896 ARA89 WOULD LIVE THERE 

208BI 001 897 NO GRAND CANYON 

20282 005 093 NO TU8S» SINKSt BUCKETS 

20263 007 891 NO WATER POWER 

20264 001 897 BLISTERS ON YOU 

20266 001 897 OCEAN WOULD GO DOWN 

20267 002 896 ATOM BOMB TESTING GROUND 

20868 001 097 YOU WOULD SEE CARAVANS 

20269 002 096 DISNEYLAND OUT OF BUSINESS 

20270 002 896 NO MOUNTAINS 

20271 003 895 NO SKIINGf SLEODlNGt ICE SKATING 

202-72 001 097 UAND WOULD BE DUST 

20273 004 894 NO GOOD SOIL 

20274 001 097 LIVE IN TENTS 

20275 OOt 897 PEOPLE THERE FOR MINERALS 

20276 001 897 NO ARNY BASES THERE 

20277 004 B94 WEST NO LONGER FAMOUS 

20278 001 097 WATER COSTS LOTS OF MONEY 

20279 001 897 NO RED WOOD TREES 

20281 001 097 COULONT ENJOY THE WEST 

20282 004 094 MORE FIRES 

;'0283 005 093 FEWER STATES 

<>0284 009- 093 NO AIR POLLUTION IN CALIFORNIA 

20205 004 894 GANT MAKE WOOD HOUSES 

20286 001 097 NO RAILROAD 

20200 003 095 7HINGS WOULD OVERHEAT 

20289 001 097 NO LAWN MOWERS 

20301 006 092 NOT ENOUGH JOBS 

2C302 002 096 HIGHER CRIME RATE IN EAST 

2C303 013 085 NO SWIMMING POOLS 

20304 002 096 MORE HIGHWAYS IN EAST 










20305 

20306 

20307 

20308 
20310 
20312 
20315 . 

20316 

20317 

20318 

20319 

20320 

20321 

20322 

20323 
2032 ^ 

20325 

20326 
20601 
20602 
20603 
20606 - 

20605 

20606 

20607 

20608 

20609 

20610 
20612 
20613 
20626 

20625 
20616 

20617 

20618 

20619 

20620 
20621 ^ 
20622 
20623 

20626 
20626 

20627 

20628 
20629 
20600 

20631 

20632 
20601 

20502 

20503 
20606 

20605 

20606 
20507 
20608 

20609 

20610 
20511 
20612 



. 

ERIC 




NOT ENOUGH FOOD 
DISEASE INCREASE 
EAST MAKE MORE MONEY 
MORE FOOD GROWN IN EAST 
MORE TRAFFIC IN N Y C 
ANIMALS MOVE EAST 
NO SAN FRISKO BAY 

IN EAST NEEDED HOUSESt STORESfFARMSt SCHOOLSt HOSPITALS 

MORE FACTORIES IN EAST 

SHIMMING POOLS CROHOED 

LACK OF ROON FOR HOMESt SCHOOLSt FARMS 

LESS LAND PER OWNER 

MORE PRODUCTION IN EAST 

NEW FRIENDS AND HOMES 

DOCTORS AND MEDICINE NEEDED 

SAND BLOWN EAST 

LESS SPACE TO GROW FOOD 

LACR OF CLOTHES 

MEN COULDNT SHAVE 

LOST OF MONEY 

NO D*tlNKS LIKE KOOL>AIDE 

PEOPLE LOSE JOBS 

THINGS GO OUT OF BUSINESS 

PEOPLE MOVE TO OTHER COUNTRIES 

EAT SEA FOOD 

FLANES LAND ANYWHERE 

N8 BIG GAME IN WEST 

NATION BBCOME POOR 

MORE IMPORTING DONE 

RUSSIA WOULD TAKE OVER 

AIRLINES OUT OF WORK 

NOMADS WOULD LIVE THERE 

MANY FUNERALSt KILLINGSt DEATHS 

WE WOULD BE CONQUERED 



LESS OXYGEN 

LESS FLOODS 

PEOPLE EAT EACH OTHER 

AMERICAN HISTORY WOULD BE DIFFERENT 

MORE GO TO CHURCH 

HARD TO LIVE 

ENDANGER THE ECONOMY 

GQLOWATER OUT OF BUSINESS 

LITTCE COMMUNICATION 

NO RAIN BOH 



NO LIFE GUARDS 
NO WARS THERE 
PEOPLE MOVE TO SHIPS 
PEOPLE EXPLORE IT 
NO SHADE IN WEST 
ANIMALS WOULD DIE 
PEOPLE WOULD MOVE 
NO SPECIFIC ANIMALS 
BE VERY HOT 
NOTHING TO DRINK 
NO TOWNS IN WEST 
FOOD NEEDED 
WATER WOULD EVAPORATE 
NO HOUSES IN WEST 
NO FARMS IN WEST 
PLANTS WOULD DIE 









. 

ERIC 







I 20623 


051 


847 


FEMER LAKEStRlVERStPONOS 


1 20625 


044 


864 


PEOPLE MIGHT DIE 


1 20516 


102 


796 


GRASS MOULD DIE 


1 20527 


030 


868 


NO RAIN IN WEST 


1 .20618 


Oil 


887 


NO 80ATSt DOCKSt BOAT MOTORS 


1 20619 


020 


878 


NO CATTLE THERE 


1 20620 


017 


881 


LOTS OF CACTUS IN WEST 


I 20621 


033 


865 


STARVATION 


1 20522 


040 


858 


DIE FROM LACK OF WATER 


1 20623 


012 


886 


NO SCHOOLS THERE 


1 20524 


001 


897 


NO GAS STATIONS 


1 20625 


001 


897 


NO FISHING HOLES 


1 20626 


019 


879 


NO FRUIT* VEGETABLES* OR MEAT 


1 20527 


080 


818 


COULONT GROW CROPS 


1 20629 


007 


891 


LESS FACTORIES 


1 20630 


003 


895 


NO RANCHES 


1 20531 


001 


897 


NO HOSPITALS 


1 20532 


003 


895 


NO FURNITURE 


1 20683 


005 


893 


NO STORES 


1 20634 


006 


892 


NO BUILDINGS 


i 20635 


002 


896 


NO NEED FOR HARBORS 


1 20636 


003 


895 


HEAT WOULD KILL PEOPLE 


1 20537 


002 


896 


NO CHURCHES 


1 20638 


001 


897 


NO HATER PUMPING STATIONS 


1 20539 


001 


897 


NO CATTLE RANCHES 


1 20640 


006 


892 


WELLS WOULD GO DRY 


1 20541 


001 


897 


CITIES WOULD CHANGE 


1 20642 


006 


892 


NO FARMERS THERE 


1 20601 


019 


879 


LOTS OF SAND 


I 20602 


030 


868 


WATER NEEDED 


1 20603 


029 


869 


COULDNT STAY CLEAN 


1 20604 


018 


880 


NO VEHICLES IN WEST 


1 20605 


003 


895 


BE A CATASTROPHE* AWFUL 


1 20606 


021 


877 


NO SHIMMING 


1 20607 


003 


895 


PEOPLE GO CRAZY 


1 20608 


001 


897 


COULDNT USE MUCH WATER 


1 20610 


005 


893 


LESS TRANSPORTATION 


1 20611 


005 


893 


COULDNT COOK 


P 20612 


001 


897 


COULDNT WASH CLOTHES 


i 20613 


002 


896 


NO WATER FOR ANIMALS 


1 20614 


001 


897 


CANT GO MANY PLACES 


1 20701 


001 


897 


HATER AND HOOD NEEDED FROM ELSEWHERE 


1 20702 


001 


897 


GO TO SPACE . 


1 20703 


001 


897 


FIND WAY TO GET WATER 


1 20704 


006 


892 


MORE IRRIGATION 


1 20705 


001 


897 


BUY MORE LAND 


1 20706 


001 


897 


REBUILD THE WEST 


1 20801 


052 


846 


LACK OF PEOPLE IN WEST 


1 20002 


014 


884 


POPULATION DECREASE IN WEST 


1 20803 


009 


889 


PEOPLE MOVE NORTH OR SOUTH 


1 20804 


027 


871 


CROWDED CITIES AND STATES 


1 20805 


116 


782 


OVERPOPULATED IN EAST 


1 20806 


001 


897 


COULDNT GET WATER 


1 30102 


012 


886 


NO MORE SWIMMING 


1 30103 


002 


896 


SURF AND SKATE BOARDS USED 


1 30104 


003 


895 


NEW CARS BUILT 


1 30105 


0^1 


897 


CARTS TO MOVE IN 


1 30106 


002 


896 


WOULD FLOAT 


1 30301 


001 


897 


NEED LOWER HOUSES 


1 30303 


003 


895 


LEGS WOULD GIVE OUT 



51 

45 

102 

30 

11 

20 

17 
33 
40 
12 

1 

1 

19 

80 

7 

2 

1 

3 

6 

6 

2 

3 

2 

1 

1 

6 

1 

6 

19 

30 

29 

18 
3 

21 

3 

2 

5 

5 
1 
2 
1 
1 
1 
1 

6 
1 
1 

53 

13 

9 

29 

116 

1 

11 

2 

3 

1 

2 

1 

3 
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1 


30004 


002 


896 


STRAPS EVERYWHERE 


1 


30306 


001 


897 


SHELVES HAOE LOWER 


1 


30307 


001 


897 


ROBOTS USED 


'f 


30308 


001 


897 


PEOPLE NEED TO CHANGE 


f 


30309 


004 


894 


RAILS EVERYWHERE 


1 

'ii 


30320 


001 


897 


PEOPLE TAKE TO WATER 




30321 


001 


897 


LOW DOOR KNOB 


i 


30312 


001 


897 


PEOPLE NEED WINGS 


1 

i 


30323 


001 


897 


INVENT A HEAD PAD 


1 


30324 


001 


897 


CLOTHES MADE WITH PADS 


1 


30325 


001 


897 


HEADS LOBSIDED 




30326 


001 


897 


USE FOR STORES IF STORES MOVED 




30327 


002 


896 


THINGS PUT LOWER 


\ 


30328 


002 


896 


NEW KINO OF CHAIRS AND BEOS 


‘i 


30329 


001 


897 


LOW TABLES AND STOVES 




30401 


024 


674 


STARVATION 




30402 


015 


683 


COULDNT READ OR WRITE 




30403 


001 


897 


NO POINTED OBJECTS 




30405 


001 


897 


COULDNT WRITE AT BLACKBOARD 




30406 


005 


555 


COULDNT SEE WELL 




30407 


015 


883 


NO GAMES PLAYED 




30408 


027 


871 


CANT GO TO SPECIFIC PLACES 




30409 


004 


894 


DIE OF THIRST 




30421 


001 


897 


COULDNT DO HOMEWORK 




30412 


.004 


894 


COULDNT EAT PROPERLY 




30423 


001 


897 


LOSS OF COMMUNICATION 


i 


30601 


001 


897 


COULDNT TAKE SHOWER 




30604 


004 


894 


EVERYONE DIZZY 




30505 


003 


695 


COULDNT HUNT 




30606 


004 


894 


COULDNT CLEAN HOUSE 




30507 


002 


897 


COULDNT CARRY ANYTHING 




30608 


003 


895 


GOOD POSTURE NOV NEEDED 




30609 


001 


897 


COULDNT MOW LAWNS 




30510 


002 


696 


PEOPLELOSE MONEY 




30621 


001 


897 


HANDS BECOME PAHS 




30623 


010 


888 


COULDNT REACH HIGH THINGS 




30J514 


036 


862 


NO ACROBATS 




30516 


001 


897 


CENTER OF GRAVITY LOST 




30529 


001 


897 


NO TALL DOORS NEEDED 




30520 


001 


897 


HATS FALL OFF 




30521 


003 


895 


NO TRICK-OR-TREATING 




30523 


001 


897 


COULDNT CARE FOR CHILDREN 




30524 


010 


888 


COULDNT ATTEND JOBS 




30525 


002 


896 


COULONT FEED PETS 




30626 


002 


896 


DOCTORS MUST SIT 




30527 


001 


897 


NO ONE TALL 




30528 


003 


895 


COULONT OPEN THINGS 




30529 


001 


897 


COULDNT CUT TREES 




30590 


001 


897 


PEOPLE FAINTING 




30591 


001 


897 


NO DEER SEASONS 




30582 


001 


897 


DOCTORS COULDNT OPERATE 




30593 


001 


897 


NO PLAYGROUND 




30694 


001 


897 


NO STANDING JOBS 




30595 


005 


893 


LACK OF SPECIFIC JOBS 


> 


30696 


001 


897 


NO BALANCE BALLS ON NOSES 




30604 


001 


897 


SOFT SIDEWALKS 




30605 


012 


886 


NO LEGS 


1 


30607 


001 


897 


SKYSCRAPERS NEEDED 


i 

1 


30610 


002 


896 


WOULDNT NEED LADDERS 


i] 


30621 


003 


895 


MORE DROWNING 
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90622 

90613 

30624 

30620 

30627 

90616 

30629 

30620 

30621 
90622 

30623 

30624 

30625 

30626 

30627 
90628 
30629 

30690 

30691 

30692 

30693 

30694 
30635 
30696 
30637 
30698 
90699 
90640 
30641 
30791 

30703 

30704 

30705 

30706 

30707 
30706 

30709 

30710 
30721 

30712 

30713 

30714 
S0715 

30716 

30717 
30728 
30719 

30801 

30802 

30803 

30804 

30805 

30806 
30607 

30808 

30809 

30810 
30821 
30812 
30823 



001 897 
004 894 
001 897 
001 897 
001 897 
004 894 

003 895 
001 897 
001 897 

004 894 
010 888 
020 888 
001 897 
001 897 
001 897 

005 893 
001 897 
001 897 

001 897 

002 896 

001 897 

002 896 
004 894 
001 897 
001 897 
001 897 
001 897 
001 897 

001 897 
025 873 
104 794 
004 894 
108 790 
024 874 

019 879 

002 896 
001 897 
001 897 

020 876 
007 891 

003 895 

003 695 
001 897 
001 897 
001 897 
001 897 
001 897 
069 829 

004 894 
093 805 
018 880 
078 820 
010 888 
010 888 
007 891 
004 194 
001 897 
003 895 
001 897 
001 897 



COULONT CROSS DEER WATER 
FEET NOT NEEDED 
MASS SIT-IN 
YOU MOULD SEEM DRUNK 
ROBBERS GET MONEY ON GROUND 
NO MORE MARS 



NO ACCIDENTS 
DIE OF SHOCK 
MORE PRAYING 
COULONT 00 UP IN SPACE 
MORE DISEASES 
EVERYONE LIKE BABIES 
LESS MURDERS 

SHORTAGE OF PEOPLE FOR JOBS 

LESS VIOLENCE 

LESS FIGHTING 

NO TREE HOUSES 

PLAY STOOP TAG MORE 

GOD MOULD DO AS HE WANTED 

LACK OF MUSCLES 

LOSE THINGS FROM HANDS 

COULONT ROB BANK 

NO OLYMPICS 

EARTH TURNING FAST 

COULONT BURY DEAD 

COULONT FIRE GUNS 

PEOPLE ALWAYS LATE 

NO GAMES TO TOKYO 

NO MORE PARADES 

HOSPITALS CROWDED 

SOME PEOPLE DIE 

EVERYONE DIRTY 

PEOPLE FALL AND GET HURT 

BUMP INTO EACH OTHER 

MORE DOCTORSt HOSPITALSt NURSESt NEEDED 

MORE AMBULANCES 

DOCTORS MAKE LOTS OF MONEY 

MORE HOSPITAL BILLS 

CAR WOULD BE WRECKED 

PEOPLE GET RUN OVER 

MEDICINE NEEDED 

HARD TO GO TO DOCTOR 

SOME DIE OF HEART ATTACK 

HOSPITALS MAKE MORE MONEY 

AIRPLANES CRASH 

CHILDREN CRYING 

LOTS OF CASTS 

NO CARSt AlRPLANESt TRUCKSt BUSES 
NO TRAINS 

COULONT DRIVE OR RIDE 
COULONT TRAVEL 
COULONT RIDE BIKES 
NO MORE TRANSPORTATION 
COULONT RIDE HONDAS 
CANT RIDE PONIES 
NO MORE BOATING 
NO TRACTORS 

NO MORE AIRPLANE FLYING 
NO SLEDS 

LESS GAS AND OIL NEEDED 



1 

4 

1 

1 

1 

4 

3 
1 
1 

4 
10 
10 

1 

1 

1 

5 
1 
1 
1 
2 
1 
2 
4 
1 
1 
1 
1 
1 
1 

23 

102 

4 

107 

25 

19 
2 
1 
1 

20 
7 
3 

3 
1 
1 
I 
1 
1 

68 

4 
93 
17 
76 
10 
10 

7 

4 

1 

3 

1 

1 
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30901 


024 


874 


STAY IN BED 


30902 


017 


881 


CHAIRS NEEDED 


30903 


026 


872 


LAY DOWN 


30904 


008 


890 


EVERYONE BE CLUMSY 


30905 


122 


776 


EVERYONE CRAWL 


30906 ^ 


027 


871 


PEOPLE LYING EVERYWHERE 


30907 


010 


888 


GET MORE SLEEP 


30908 


004 


894 


COOK ON FLOORS 


30909 


001 


897 


PEOPLE LEAN ON STUFF 


30910 


003 


895 


PEOPLE WOULD ROLL 


30911 


003 


895 


MORE BANDAIDS 


30912 


003 


895 


NEW CLOTHES NEEDED 


30913 


003 


895 


HOLD ONTO SOMETHING 


30914 


001 


897 


HAVE TO LOOK UP 


30915 


002 


896 


NEED CLEAN RUG 


30916 


001 


897 


STANDS NEEDED 


30917 


001 


897 


LEAN ON EACH OTHER 


30918 


002 


896 


MORE PILLOWS AND CUSHIONS 


30919 


001 


897 


MORE SOFT GRASS 


30920 


001 


897 


CRAWLING RACES 


30921 


001 


897 


TAKE LITTLE STEPS 


31001 


029 


869 


NO SIDEWALKS 


31002 


001 


897 


NO SHOE MAKERS 


31003 


013 


885 


SHOES UNNECESSARY 


31004 


007 


891 


NO ROADS 


31005 


002 


896 


NO CONCRETE OR CEMENT 


31006 


004 


894 


NO WALKING ON SIDEWALKS 


31007 


004 


894 


PEOPLE BECOME LAZY 


31008 


001 


897 


COULDNT GET TO BATHROOM 


31009 


001 


897 


FEET WOULDNT GET TIRED 


31010 


003 


895 


GET FAT 


31011 


001 


897 


WEAR OUT GRASS 


31012 


002 


896 


ROADS GROW UP WITH WEEDS 


31013 


002 


896 


CANT TAKE DOG FOR WALK 


31014 


002 


896 


NO SOCKS 


31015 


001 


897 


FORGET HOW TO WALK 


31016 


001 


897 


NO WALKING CLUBS 


31101 


009 


889 


WE WOULD BE HELPLESS 


31105 


001 


897 


NO PEOPLE AFTER A WHILE 


31108 


007 


891 


TRAGEDY. DISASTER 


Still 


007 


891 


WOULD BE FUNNY 


311E2 


001 


897 


WORLD NEED HELP 


31113 


004 


894 


FUNN WORLD 


31124 


014 


884 


PEOPLE GO CRAZY 


31115 


002 


896 


HARD TO GO PLACES 


31126 


002 


896 


PEOPLE ACT STUPID 


31127 


004 


894 


PEOPLE KILL THEMSELVES 


31128 


001 


897 


THINGS NOT UNDERSTOOD 


31119 


009 


889 


SPECIFIC REACTIONS 


31120 


001 


897 


MORE SORROW AND FEARS 


31121 


004 


894 


BE MISERABLE 


31122 


001 


897 


BE AWKWARD WORLD 


31123 


002 


896 


GET TIRED OF BEING DOWN 


31124 


002 


896 


MORE CARELESSNESS 


31125 


002 


896 


A BIG MESS 


31126 


002 


896 


HARD LIFE 


31127 


002 


896 


NOT KNOW WHAT TO DO 


31128 


001 


897 


SOMETHING MUST BE DONE 


31129 


001 


897 


PEOPLE RESTLESS 


31190 


002 


896 


LIFE BE DANGEROUS 



AlO 
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31191 


001 


897 


TIME WASTED 


31192 


001 


997 


PEOPLE GET PANICKY 


31193 


002 


896 


WOULDNT LIKE IT 


31194 


001 


897 


PEOPLE LOSE PATIENCE 


31135 


001 


897 


PEOPLE WANT TO DIE 


31186 


002 


896 


NOTHING WOULD BE DONE 


31197 


001 


897 


EVERYONE TRY TO GET IT BACK 


31196 


001 


897 


WOULD BE STRANGE 


31202 


001 


897 


MORE KNEE PADS 


31204 


008 


890 


COULDNT LIFT THINGS 


31205 


012 


886 


MORE CRUTCHES 


31206 


035 


«63 


MORE WHEELCHAIRS 


31208 


002 


696 


NEED FOR WALKERS 


31209 


013 


685 


BREAK THINGS 


31210 


004 


694 


NO FACTORIES 


31221 


010 


688 


NO STORES 


31212 


001 


897 


NO SHOPPING CENTERS 


31213 


001 


897 


THINGS SHUT DOWN 


31214 


002 


896 


WOULDNT NEED TABLES 


31215 


001 


897 


MORE STROLLERS 


31301 


006 


892 


NO JUMPING ROPE 


31302 


093 


805 


COULONT EAT OR DRINK 


31304 


017 


881 


NO FARMING 


31305 


017 


861 


COULONT GUILD THINGS 


31306 


045 


853 


NO SPORTS 


31307 


023 


875 


MORE SITTING DOWN 


31308 


006 


692 


BABIES COULONT LEARN TO WALK 


31309 


010 


888 


COULDNT DANCE 


31310 


001 


897 


NO SHOWS OF STUNTS 


31311 


001 


897 


NO DANCERS OR ACTORS 


31312 


002 


896 


NO BUSINESS MAN 


31313 


047 


851 


COULDNT RUNf SKIPt KICK 


31314 


003 


895 


COULDNT PUT CLOTHES ON 


31315 


001 


897 


CANT COMB HAIR 


31316 


001 


897 


COULONT GET IN BED 


31317 


002 


696 


COULONT EXERCISE 


31318 


007 


891 


NO GARDENS 


31319 


002 


896 


STAY HOME ALL DAY 


31320 


001 


897 


NO TRAMPOLINES 


31321 


006 


892 


COULONT CLIMB 


31322 


001 


897 


NO SPORTING EQUIPMENT 


31323 


001 


897 


NO ATHLETES 


31324 


002 


896 


COULONT WORK 


31325 


001 


897 


COULONT STAND ON HEAD 


31326 


001 


897 


COULONT ANSWER PHONE 


31327 


001 


897 


LACK OF PHYSICAL HEALTH 


31328 


002 


896 


HARO TO FIX MEALS 


31329 


001 


897 


COULDNT USE TEETER TODERS 


31330 


001 


697 


NO STANDING UP ACTIVITIES 


31391 


001 


897 


NO CHASE ON FOOT 


40101 


001 


897 


USE OF SIGNS 


40103 


001 


897 


MEMORIES IMPROVED 


40104 


001 


897 


READ AS BLIND PEOPLE 


40105 


001 


897 


PUSH BUTTON WORKERS NEEDED 


40201 


001 


897 


NO FREEDOM OF PRESS 


40203 


oil 


887 


NO BANKS 


40204 


044 


854 


NO MONEY 


40205 


006 


892 


NO PLAYS 


40206 


007 


691 


NO TAXES 


40208 


008 


890 


NO PAPER ROUTES 
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12 

35 
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13 
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92 

17 

16 

45 

23 



6 

10 

1 

1 

1 

46 

3 

1 

1 

2 

7 

2 

1 

6 

1 

1 
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1 
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1 
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1 
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11 

44 
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40209 
40220 
4022 r 
40212 

40219 
40214 
40225 

; 40226 
40227 
40218 
40229 

40220 

40221 

40222 
40229 
40225 

40227 

40228 

40229 

40290 

40291 

40292 
40299 

40294 

40295 

40296 

40297 

40298 

40239 

40240 

40241 

40242 

40243 

40244 

40245 
40301 

40303 

40304 

40305 
40307 
40908 

40309 

40310 

40311 

40312 

40313 

40314 

40315 

40316 

40317 

40320 

40321 

40503 

40504 

40505 

40506 

40602 

40603 

40605 

40606 



021 

003 

005 
001 
001 
012 
001 
003 
015 
003 
007 

007 
001 

006 
020 
001 
006 
001 
006 
012 
001 
010 
002 
002 
006 
001 
001 
001 
003 
001 
001 
001 
002 
001 
001 

008 
006 
005 

013 
001 
001 

014 
005 
001 

003 
002 

004 

004 
001 

005 
001 
001 
002 
001 
001 
001 
018 
003 
001 
002 



877 
895 
8193 
897 
897 
886 
897 
895 

883 

895 
891 

891 
897 

892 

878 
897 
892 
897 
892 
886 
897 
888 

896 

896 
892 

897 
897 
897 

895 
897 
897 
897 

896 

897 
897 
890 

892 

893 
885 
897 
897 

884 

893 
897 

895 

896 

894 

894 

897 
893 
897 
897 

896 

897 
877 
897 
880 

895 
897 

896 



NO BILLS 
NO HATCHES 
NO POSTERS 
NO ARCHEOLOGISTS 
NO REPORTERS 
NO CALENDARS 
NO SENATE 
NO INSURANCE 
NO LAWS OR LAWYERS 
NO TELEPHONE BOOK 
COULONT FLY PLANES 
GET WRONG FOOD 
NO INSTRUMENT LESSONS 
NO NOON TRIPS 
NO LABELS ON THINGS 
STOCK PRICES GO DOWN 
NO CONTRACTS 
NO SHEET MUSIC 
NO CHECKS 
NO ADVERTISEMENTS 
NO BILLFOLDS 
NO TIME 
LESS CARS 
NO MORE VOTES 
COULONT MAKE THINGS 
NO BLUEPRINTS 
NO BIRTH CERTIFICATES 
NO ASTRONAUTS 
NO SCIENTISTS 
NO SCHOLARS 
NO RENT 

NO STOCK EXCHANGE 

NO NEWS PAPER PRESSES 

NO TREATIES 

NO RECEIPTS 

NO GLASSES NECESSARY 

NO FAMOUS WRITERS 

NO TYPEWRITERS 

COULONT FINISH THIS TEST 

NO GREAT SPEECHES GIVEN 

TAPE RECORDED BOOKS 

NO SECRETARIES OR OFFICE WORK 

NO LIBRARIANS 

NO BOOK CAROS 

TELEGRAPH WOULD STOP 

NO PENCIL SHARPENERS 

NO PEN PALS 

NO BUSINESS OFFICES 

NO TEST PAPERS 

NO REPORT CAROS 

NO BOOK MARKS 

NO PAPER CUTTERS 

EAT POISON BY MISTAKE 

SMARTER PEOPLE SLAVE US 

MORE SPORTS 

THIEVES ROAM COUNTRY 

MORE ACCIDENTS 

ANOTHER DARK AGES 

MORE SALESMEN 

NO POLICE TICKETS 




21 

3 

5 
1 
1 

12 

1 

3 

15 

3 

7 

6 
1 

5 

20 

1 

6 
1 
6 

12 

1 

10 

2 

2 

6 

1 

1 

1 

3 

1 

1 

1 

2 

1 

1 

8 
6 
5 

13 

1 

1 

15 

5 

1 

3 
2 

4 

4 
1 

5 
1 
1 
2 
1 
1 
1 

18 

3 

1 

2 
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40607 

40608 

40609 

40610 

40611 

40612 

40613 

40614 

40615 
40618 
40627 

40618 

40619 

40621 

40622 

40623 

40624 

40625 

40626 

40627 

40701 

40702 

40703 

40704 

40705 

40706 

40709 

40710 

40711 

40712 

40713 

40714 

40715 

40716 

40801 

40802 

40803 

40804 

40805 

40806 

40807 

40810 

40811 
40822 

40813 

40814 

40815 

40816 

40817 
40801 

40902 

40903 

40904 

40905 

41001 

41002 

41005 

41006 

41007 

41008 



003 895 
001 897 
001 897 
015 883 
001 897 
001 897 
005 893 
001 897 

001 897 
029 869 

007 891 
003 895 

002 896 
001 097 

003 895 
001 897 

003 895 
001 897 
001 897 
001 897 

004 894 

008 890 
Oil 887 
121 777 

001 897 
004 894 

004 894 

002 896 

003 895 
001 897 
008 890 

001 897 
003 895 

003 895 

005 893 

006 892 
035 863 
075 823 

002 896 

001 897 
010 888 

002 896 
001 897 

001 897 

004 894 

002 896 
001 897 
001 897 

004 894 
058 840 

005 893 
005 893 

003 895 
001 897 
001 897 

007 891 
007 091 

001 897 

002 896 

003 895 



GET CHEATED BY LAND SELLERS 
NO SIGNING FOR FOOTBALL 
COULONT READ NAMES OF SONGS 
NO STORIES 

COULONT TELL SCORE IN BOWLING 
NO SORE FINGERS FROM WRITING 
WOULDNT USE GOOD ENGLISH 
COULONT GO TO OTHER COUNTRIES 
COMMERCE WOULD DROP 
NO MAILMAN 

WOULONT KNOW WHERE TO GO 

NO SPEED LIMIT 

NO USE FOR DRIVERS TEST 

WOULONT KNOW RIGHT MEDICINE TO TAKE 

NO READING CLASS 

COULONT IDENTIFY BELONGINGS 

NO WRITING CLASS 

BOONS BE ANTIQUES 

PRESIDENT COULONT SIGN BILLS 

NO STORYTOWN 

NO BOOKS PUBLISHED 

DECLINE IN SALE OF PAPER 

NO ERASERS 

NO PENCILS OR PENS 

NO MAGAZINE RACKS 

NOT KNOW ABOUT BOOKS 

NO NOTEBOOKS 

NO STAMPS 

NO POST CAROS 

NO ENVELOPES 

NO CHALK 

NO BIRTHDAY CAROS 
NO RULERS 
NO BOOK STORES 
NO RECORDED HISTORY 
DECREASE IN COMMUNICATION 
END OF POSTAL SYSTEM 
NO SIGNS OR MAPS 
NO GRADES IN SCHOOL 
COULONT WORK PROBLEMS 
NO WRITTEN RECORDS 
NO LICENSE 

COULONT READ NAMES OF TOWNS 
MIGHT FORGET ALPHABET 
NO WRITTEN REPORTS 
NO GLOBES 
NO MENU 

NO NAMES ON MAIL BOXES 
NEWS WOULD DECREASE 
MORE RADIOS 
TELEPHONES USED MORE 
TALKING ALL THE TIME 
HAVE TO LISTEN 
RECORD PLAYERS INCREASE 
DECAY OF CIVILIZATION 
BUSINESS FAILURES 
00 MORE DRAWING 
EVERYTHING GO TO WASTE 
HAVE TO START OVER AGAIN 
PEOPLE IN CONFUSION 
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USE SIGNALS 
BE A BIG MESS 
NO MODEAN THINGS 
UNORGANIZED GOVERNMENT 
BOOK COMPANIES FAIL 
PAPER FACTORIES FAIL 
PENCIL FACTORIES FAIL 
NEWSPAPER BUSINESS FAIL 
PEOPLE GO CRAZY 
NO PRINT SHOPS 
NEW LANGUAGE NEEDED 
LESS JOBS 
NO ALPHABET 
NO BOOKS 

NUMBERS NOT NEEDED 
GET LESS MONEY 

COULDNT READ SPECIFIC THINGS 

COULDNT WRITE SPECIFIC THINGS 

NO BLACK BOARDS 

NO SPELLING 

LOSE FRIENDS 

NO CLOCKS 

NO SCHOOLWORK 

PLAY MORE 

MORE TV WATCHING 

NO SPORTS PAGE 

NO TEACHER GETTING NOTES 

NO CATELOGUES 

NO COMICS 

NO REFERENCES 

NO MESSAGES 

TV PEOPLE MAKE MONEY 

NO NOTES 

NO BILL BOARDS 

BULLETINS OR BOARDS 

MORE MOVIES 

NO TV GUIDE 

NO BIBLE 

MORE TIME FOR OTHER THINGS 
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APPENDIX B. The Test Battery 
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APPEiroiX B 



THE TEST BATTERY 



Gestalt Transformation (Redefinition) 

Select one of the five alternative objects, or parts of objects, 
to be used to serve a stated purpose. A sample item reads: TO LIGHT 

A FIRE. 1. Cabbage, 2. Fish, 3. Pocket watch, 4. String, 5. Pipe 
stem. Answer; Pocket watch (use cover as condensing lens). Parts, 1. 
Items, 10. Working time, S min. 

Guilford’s factor NMT semantic redefinition (convergent produc- 
tion of semantic transformations). 



Alternate Uses (Flexibility) 

List as many as six uses for an object, such as a newspaper, other 
than the common use, which is stated. Parts, 2. Items, 3 per part. 
Working time, 8 min. 

Guilford’s factor DMC semantic spontaneous flexibility. Divergent 
Production of semantic classes. A revision of his Unusual Uses Test. 



Plot Titles (Originality-clever) 

Write titles for a -:hort story; only clever titles being accepted. 
Parts, 2. Items per part, 1. Working time, 6 min. 

Guilford’s factor DMT - Originality (semantic adaptive flexibility) 
Divergent Production of semantic transformations. 



Seeing Problems (Sensitivity) 

List as many as five different problems connected with a common 
object. Score consists of all problems dealing with the structure, 
use or operation of the object. Parts, 2. Items per part, 3. 

Working time, 8 min. 

Guilford’s EMI, (Sensitivity). Evaluation of semantic implications. 



Consequences - Remote Score (Originality-remote) 

Give remote (distant in time or in space or in sequence of events) 
consequences for a specified event. Parts, 4. Items per part, 1. 
Working time, 8 min. 






Guilford’s Dlff (semantic adaptive flsKioility) . Divergent produc- 
tion of semantic transformations. 



Consequences - Total Score (Ideational Fluency) 



List consequences of a proposed unusual event. Parts, 4. Items 

per part, 1, Working time, 8 min. Score is total of obvious and re- 
mote responses. 



Guilford’s DMU (ideational fluency). Divergent production of 
semantic units. 
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